Senior Data Engineer

Afresh is on a mission to eliminate food waste and make fresh food accessible to all. Our first A.I.-powered solution optimizes ordering, forecasting, and store operations for fresh food departments in brick-and-mortar grocers. With our Fresh Operating System, regional and national grocery retailers have placed $1.6 billion in produce orders across the US and we’ve helped our partners prevent 34 million pounds of food from going to waste. Working at Afresh represents a one-of-a-kind opportunity to have massive social impact at scale by leveraging uncommonly impactful software. About the Role As a Senior Data Engineer, you’ll play a key role in scaling and improving how we integrate and process customer data. You will design and implement ETLs that reliably process large volumes of customer-provided data and build tools to improve the platform to make customer integrations faster, more accurate, and more scalable. You’ll also contribute to the development of new features that support our expanding product lines. Your work will have a direct and visible impact on our ability to onboard customers more easily and quickly and power our machine learning grocery solution. What You’ll Do Build tools and frameworks that streamline customer integrations, enabling faster onboarding and better handling of customer data. Create robust ETLs in PySpark and DBT to process billions of records from customer datasets, ensuring data is accurate, reliable, and ready for downstream use. Investigate and implement new technologies into the data platform, focusing on practical solutions that address current pain points and anticipate future needs. Collaborate with product, engineering, and go-to-market teams to design and deliver data solutions for new products and features. Identify and implement optimizations to improve ETL runtime and data processing scalability, reducing the time and effort required for integrations. Solve real-world data quality challenges by working directly with messy, incomplete, or inconsistent customer data to extract the signal we need. Support team members by mentoring engineers, leading technical discussions, and providing clear, actionable feedback. What Makes You a Great Fit We encourage all highly-qualified candidates to apply, even if they don’t meet every listed qualification. Significant experience designing and maintaining ETLs that process large-scale datasets. Proficiency with Python, PySpark, SQL, and experience working on platforms/tools like Databricks, Snowflake, or DBT. Strong problem-solving skills and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions. A focus on practical outcomes—you're skilled at balancing technical rigor with the need to get things done. Experience working directly with complex, unclean datasets and finding innovative ways to process and analyze them. A knack for identifying areas where tooling or automation can simplify workflows and reduce manual effort. Excellent communication skills—you’re able to explain your ideas clearly to both technical and non-technical audiences. Proven leadership in technical projects, with a willingness to mentor and help others grow. Why Work Here Join a mission-driven company reducing millions of pounds of food waste in grocery stores per year. Work on challenging, real-world problems that have a direct impact on our customers. Be part of a collaborative, supportive team where your ideas are valued and acted on. Use cutting-edge tools and platforms to solve meaningful data challenges. We’re looking for someone who thrives on tackling complex data problems and takes pride in building systems that work seamlessly at scale. If that sounds like you, we’d love to hear from you About Afresh Founded in 2017, Afresh is working on the #1 solution to curb climate change: reducing food waste. By combining human insight and transformative technology, we’re helping grocers provide fresher food to customers at more affordable prices. Afresh sits at an incredible intersection of positive social impact, rocket ship financial growth, and cutting-edge technology. Our best-in-class AI research has been published in top journals including ICML, and we’ve raised over $148 million in funding from investors including former co-CEO of Whole Foods Market Walter Robb and Eric Schmidt's Innovation Endeavors. Afresh provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity/expression, marital status, pregnancy or related condition, or any other basis protected by law. Afresh prohibits discrimination and harassment of applicants or employees on the basis of any protected characteristic. Remote work is available for certain states; some roles may require being local to our San Francisco, CA office, as noted in the job posting details. #J-18808-Ljbffr