Lead Data Engineer

JOB TYPE: Freelance, Contract Position – No agencies (See notes below)

LOCATION: North America  (TimeZone:  Work Anytime  )

HOURLY RANGE: Our client is looking to pay $120  – $150 USD / HR

ESTIMATED DURATION: 40Hrs/Week – Long Term,

ABOUT US:

is the only network that gives in-demand talent all the freedom of freelance with all the benefits, community, and stability of a full-time role
As the first decentralized talent network, our revolutionary Web3 model ensures the community that relies on Braintrust to find work are the same people who own and build it through the blockchain token, BTRST
So unlike other marketplaces that take 20% to 50% of talent earnings, Braintrust allows talent to keep 100% of earnings and to vote on key changes to improve the network
Braintrust is working to change the way freelance works – for good

We’ve onboarded some of the world’s most reputable brands and now we need a Senior ……… for one of our clients
 

ABOUT OUR CLIENT:  

Wayfair Data Engineering is the engine that powers our data obsessed eCommerce enterprise
We move fast, iterating quickly on big business problems
Data Engineering efforts are instrumental in further growing our market share in a $800 billion home goods market
Every day, we ingest billions of rows of data about how people pick out the perfect items for their home, and this data is what drives our business strategies and decisions
We build cutting-edge data platforms enabling advanced analytics and insights across our business and analytics teams

 POSITION SUMMARY:

As a lead data engineer, you will be a hands-on technical leader who architects, designs, and delivers Data Warehouses, Data Lake, Self-service tooling, Real-time streaming, and Big Data Solutions for our rapidly growing Supply Chain Operations
Working within the Data Engineering organization, this individual will tightly partner with business, product managers and engineering leaders to build data platforms enabling these goals
You will be instrumental in building out the data architecture to ensure we capture the full who, what, where, when, and why as our data is generated, transformed, and mutated over time, working to build a cohesive, scalable, accurate, and performant foundational source of truth upon which all data & analytics users across the company will build

WHAT YOU’LL DO:

• • Own an entire key area of data within Wayfair from generation to consumption, such as a trillion-row clickstream dataset or product information from thousands of suppliers

  • Collaborate with your stakeholders and other business analytics team leaders to define and develop the data architecture and data solution roadmap for the functional areas you support
    

  • Act as a subject matter expert to leadership for technical guidance, solution design and best practices
    

  • Design and implement big data architecture, data pipelines, reporting, dashboarding, data exploration, processes, and quality controls to enable self-service Business Intelligence
    

  • Keep current on big data and data visualization technology trends, evaluate, work on proof-of-concept and make recommendations on the technologies based on their merit
    

  • Manage and mentor associates; ensure the team is being challenged, exposed to new opportunities, and learning, while still being able to deliver on ambitious goals
    

  • Develop a technical center of excellence within the analytics organization through training, mentorship, and process innovation
    

  • Build, lead, and mentor a team of highly talented data professionals working with petabyte scale datasets and rigorous SLAs

  • Architect and implement a monitoring and alerting approach to enable exposure of Service Level Indicators (SLIs) and exposure/adherence to Service Level Objectives (SLOs)

TECHNICAL SKILLS:

• • 7+ years of experience in Data Engineering role

  • 5+ years of experience leading or mentoring technical teams

  • 5+ years of programming experience with at least one language such as Python, Scala, Java, or other modern OOP programing language

  • 5+ years’ experience in writing SQL statements

  • 5+ years’ experience with schema design and dimensional data modeling

  • Experience building and optimizing ‘big data’ data pipelines, architectures and data sets 

  • Experienced developing in cloud platforms such as Google Cloud Platform (preferred), AWS, Azure, or Snowflake at scale

  • Experience with real-time data streaming tools like Kafka, Kinesis, Apache Storm, or any similar tools

  • Experience in designing data engineering solutions using open source and proprietary cloud data pipeline tools such as Airflow, dbt, Glue, and Beam

  • Experience in development of custom built BI and big data reporting solutions using tools like Looker, DataStudio, or any similar tools

  • Experience with code management tools (, Git, SVN) and DevOps tools (, Docker, Jenkins)

  • Excellent communication and presentation skills, strong business acumen, critical thinking, and ability to work cross functionally through collaboration with engineering and business partners

ABOUT THE HIRING PROCESS:

Qualified candidates will be invited to do a screening interview with the Braintrust staff
We will answer your questions about the project, and our platform
 If we determine it is the right fit for both parties, we’ll invite you to join the platform and create a profile to apply directly for this project
 

C2C Candidates: This role is not available to C2C candidates working with an agency
But if you are a professional contractor who has created an LLC/corp around your consulting practice, this is well aligned with Braintrust and we’d welcome your application
 

Braintrust values the multitude of talents and perspectives that a diverse workforce brings
All qualified applicants will receive consideration for employment without regard to race, national origin, religion, age, color, sex, sexual orientation, gender identity, disability, or protected veteran status