Astronomer/Airflow Architect
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Overview
EVP- Business Development and Strategy at 360 Technology LLC
Responsibilities
- Help guide a small group of technologists in their Apache Airflow journeys, including identifying new use cases and onboarding new domain teams.
- Review, optimize, and tune data ingestion and extraction pipelines orchestrated by Airflow.
- Development of frameworks to manage and engineer a large number of pipelines for the entire domain.
- Build architecture, data flow, and operational diagrams and documents, with detailed physical and logical layers.
- Provide reference implementations of various activities, including composing data pipelines in Airflow, implementing new Airflow features, or integrating Airflow with 3rd party solutions.
- Keep up with the latest Astro and Airflow features, in order to better advise the technologies on impactful improvements they can make.
- Collaborate to build reusable assets, automation tools, and documented best practices.
- Interact with Domain and Engineering teams to channel product feedback and requirements discussions.
- Work with technology team members to ensure that are realizing value in their Airflow and Astronomer journeys
Skills Required
- Experience with Apache Airflow in production environments.
- Experience in designing and implementing ETL, Data Warehousing, and ML/AI use cases.
- Proficiency in Python.
- Knowledge of Azure cloud-native data architecture.
- Demonstrated technical leadership on team projects.
- Strong oral and written communication skills.
- Willingness to learn new technologies and build reference implementations.
- Experience in migrating workflows from legacy schedulers (Tidal) to Apache Airflow.
- Experience in integrating with Azure Data Factory pipelines.
- Snowflake and Databricks experience.
- Experience working with containers.
- SQL experience.
- Kubernetes experience, either on-premise or in the cloud.
- Enterprise data experience in regulated environments.
Seniority level
- Mid-Senior level
Employment type
- Contract
Job function
- Consulting, Engineering, and Information Technology
Industries
- Banking, Investment Banking, and Financial Services
Referrals increase your chances of interviewing at 360 Technology by 2x
-
Astronomer/Airflow Architect
3 days ago
Mississauga, ON, Peel Regional District, ON; Ontario, Canada 360 Technology Full-timeOverview EVP- Business Development and Strategy at 360 Technology LLC Responsibilities Help guide a small group of technologists in their Apache Airflow journeys, including identifying new use cases and onboarding new domain teams. Review, optimize, and tune data ingestion and extraction pipelines orchestrated by Airflow. Development of frameworks to...
-
Software Architect
2 days ago
Mississauga, Peel Region, Canada HCLTech Full-time $110,000 - $190,000 ContractPrimary Skills - Tableau Architect with Snowflake.Lead the architecture, design, implementation, and ongoing evolution of enterprise Data, Analytics, AI, and Cloud solutions — providing end-to-end ownership from strategy and roadmap through delivery, operations, and continuous optimization.Collaborate with cross-functional teams to execute the enterprise...
-
Architect - travel
1 day ago
Mississauga, ON, Peel Regional District, ON; Ontario, Canada LanceSoft, Inc. Full-timeOverview Mississauga OR Montreal - Hybrid (at least 3-4 days in office because they must work with other architects too) Description Design the overall SAP BW architecture, including LSALSA concepts, data flows, and integration patterns. Architect and lead the migration replication of SAP BW data to Google BigQuery using tools such as SAP Data Services...
-
Platform Architect
1 day ago
Mississauga, ON, Peel Regional District, ON; Ontario, Canada LanceSoft, Inc. Full-timeOverview Mississauga OR Montreal - Hybrid (at least 3-4 days in office because they must work with other architects too) Description Design the overall SAP BW architecture, including LSALSA concepts, data flows, and integration patterns. Architect and lead the migration replication of SAP BW data to Google BigQuery using tools such as SAP Data Services...
-
Platform Architect
5 days ago
Mississauga, Peel Region, Canada LanceSoft, Inc. Full-time $90,000 - $120,000 ContractOverview Mississauga OR Montreal - Hybrid (at least 3-4 days in office because they must work with other architects too) Description Design the overall SAP BW architecture, including LSALSA concepts, data flows, and integration patterns. Architect and lead the migration replication of SAP BW data to Google BigQuery using tools such as SAP Data Services...
-
Software Architect
1 week ago
Mississauga, ON, Peel Regional District, ON; Ontario, Canada HCLTech Full-timePrimary Skills - Tableau Architect with Snowflake. Lead the architecture, design, implementation, and ongoing evolution of enterprise Data, Analytics, AI, and Cloud solutions — providing end-to-end ownership from strategy and roadmap through delivery, operations, and continuous optimization .Collaborate with cross-functional teams to execute the...
-
IT Software Architect
1 week ago
Mississauga, ON, Peel Regional District, ON; Ontario, Canada HCLTech Full-timePrimary Skills - Tableau Architect with Snowflake. Lead the architecture, design, implementation, and ongoing evolution of enterprise Data, Analytics, AI, and Cloud solutions — providing end-to-end ownership from strategy and roadmap through delivery, operations, and continuous optimization .Collaborate with cross-functional teams to execute the...
-
Senior GCP Data Engineer
1 day ago
Mississauga, Peel Region, Canada Capgemini Full-time €120,000 - €140,000 ContractChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of...
-
Senior Manager, Data Engineering
1 day ago
Mississauga, ON, Peel Regional District, ON; Ontario, Canada Sterling Brokers Full-time €130,000 - €170,000 TemporaryAbout Sterling Brokers Sterling Capital Brokers is a fast-growing Canadian employee benefits brokerage built on proprietary technology. We help employers design, deliver, and manage group benefits programs that produce real outcomes for their people. We move quickly, operate with a high degree of ownership, and build solutions that are purpose-fit for our...
-
Senior GCP Data Engineer
4 days ago
Mississauga, ON, Peel Regional District, ON; Ontario, Canada Capgemini Full-time €120,387 - €140,357 TemporaryChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of...
