Lead Data Engineer

JOB TYPE: Freelance, Contract Position – No agencies (See notes below)

LOCATION: North America  (TimeZone:  Work Anytime  )

HOURLY RANGE: Our client is looking to pay $120  – $150 USD / HR

ESTIMATED DURATION: 40Hrs/Week – Long Term,

ABOUT US:

is the only network that gives in-demand talent all the freedom of freelance with all the benefits, community, and stability of a full-time role. As the first decentralized talent network, our revolutionary Web3 model ensures the community that relies on Braintrust to find work are the same people who own and build it through the blockchain token, BTRST. So unlike other marketplaces that take 20% to 50% of talent earnings, Braintrust allows talent to keep 100% of earnings and to vote on key changes to improve the network. Braintrust is working to change the way freelance works – for good.

We’ve onboarded some of the world’s most reputable brands and now we need a Senior ……… for one of our clients.  

ABOUT OUR CLIENT:  

Wayfair Data Engineering is the engine that powers our data obsessed eCommerce enterprise. We move fast, iterating quickly on big business problems. Data Engineering efforts are instrumental in further growing our market share in a $800 billion home goods market. Every day, we ingest billions of rows of data about how people pick out the perfect items for their home, and this data is what drives our business strategies and decisions. We build cutting-edge data platforms enabling advanced analytics and insights across our business and analytics teams.

 POSITION SUMMARY:

As a lead data engineer, you will be a hands-on technical leader who architects, designs, and delivers Data Warehouses, Data Lake, Self-service tooling, Real-time streaming, and Big Data Solutions for our rapidly growing Supply Chain Operations. Working within the Data Engineering organization, this individual will tightly partner with business, product managers and engineering leaders to build data platforms enabling these goals. You will be instrumental in building out the data architecture to ensure we capture the full who, what, where, when, and why as our data is generated, transformed, and mutated over time, working to build a cohesive, scalable, accurate, and performant foundational source of truth upon which all data & analytics users across the company will build.

WHAT YOU’LL DO:

    • Own an entire key area of data within Wayfair from generation to consumption, such as a trillion-row clickstream dataset or product information from thousands of suppliers

    • Collaborate with your stakeholders and other business analytics team leaders to define and develop the data architecture and data solution roadmap for the functional areas you support.

    • Act as a subject matter expert to leadership for technical guidance, solution design and best practices.

    • Design and implement big data architecture, data pipelines, reporting, dashboarding, data exploration, processes, and quality controls to enable self-service Business Intelligence.

    • Keep current on big data and data visualization technology trends, evaluate, work on proof-of-concept and make recommendations on the technologies based on their merit.

    • Manage and mentor associates; ensure the team is being challenged, exposed to new opportunities, and learning, while still being able to deliver on ambitious goals.

    • Develop a technical center of excellence within the analytics organization through training, mentorship, and process innovation.

    • Build, lead, and mentor a team of highly talented data professionals working with petabyte scale datasets and rigorous SLAs

    • Architect and implement a monitoring and alerting approach to enable exposure of Service Level Indicators (SLIs) and exposure/adherence to Service Level Objectives (SLOs)

TECHNICAL SKILLS:

    • 7+ years of experience in Data Engineering role

    • 5+ years of experience leading or mentoring technical teams

    • 5+ years of programming experience with at least one language such as Python, Scala, Java, or other modern OOP programing language

    • 5+ years’ experience in writing SQL statements

    • 5+ years’ experience with schema design and dimensional data modeling

    • Experience building and optimizing ‘big data’ data pipelines, architectures and data sets 

    • Experienced developing in cloud platforms such as Google Cloud Platform (preferred), AWS, Azure, or Snowflake at scale

    • Experience with real-time data streaming tools like Kafka, Kinesis, Apache Storm, or any similar tools

    • Experience in designing data engineering solutions using open source and proprietary cloud data pipeline tools such as Airflow, dbt, Glue, and Beam

    • Experience in development of custom built BI and big data reporting solutions using tools like Looker, DataStudio, or any similar tools

    • Experience with code management tools (e.g., Git, SVN) and DevOps tools (e.g., Docker, Jenkins)

    • Excellent communication and presentation skills, strong business acumen, critical thinking, and ability to work cross functionally through collaboration with engineering and business partners

ABOUT THE HIRING PROCESS:

Qualified candidates will be invited to do a screening interview with the Braintrust staff. We will answer your questions about the project, and our platform.  If we determine it is the right fit for both parties, we’ll invite you to join the platform and create a profile to apply directly for this project.  

C2C Candidates: This role is not available to C2C candidates working with an agency. But if you are a professional contractor who has created an LLC/corp around your consulting practice, this is well aligned with Braintrust and we’d welcome your application.  

Braintrust values the multitude of talents and perspectives that a diverse workforce brings. All qualified applicants will receive consideration for employment without regard to race, national origin, religion, age, color, sex, sexual orientation, gender identity, disability, or protected veteran status.