Lead Data Engineer

We are Two Circles. We are a Sports & Entertainment Marketing business. We grow audiences and revenues. We do that by knowing fans best. We work with clients to help them understand & influence what their fans are doing – the way fans spend their money, the events that fans attend, the channels fans respond to, the content fans watch and more. And we use the understanding this gives us to help our clients grow. Grow their audiences and grow their revenues - both direct to consumer and business to business revenues. Our platforms and services are trusted by over 1000 clients globally, including the English Premier League, Red Bull, UEFA, VISA, the NFL, Nike and Amazon. We are over 1000 people, based out of 15 offices, and we deliver work for sports and entertainment businesses of all shapes and sizes all over the world.Two Circles is looking for a Data Engineer to join our dynamic KORE Intelligence Platform team. In this role, you'll be a key part of our Partnership Intelligence > Measurement Team that specializes in the ingestion, transformation, and storage of large-scale social and broadcast data. Working under the guidance of an experienced Data Engineers and Architects, you will gain hands-on experience designing and maintaining scalable, efficient data pipelines that support enterprise web applications, analytics, and business intelligence.About The RoleWe are seeking a senior Data Engineer to join our Measurement team in the Partnership Intelligence Platform. You will round out the team with expertise in directly managing AWS Services, with technologies such as Airflow, Snowflake, MS SQL Server and .Net. Experience designing and managing large scale data pipelines is a must for this role, as well as a keen interest to explore new technologies and solutions. We are looking for someone who brings experience and passion working with the flow of data and infrastructure.Key ResponsibilitiesWork as part of a cross-functional product team to deliver a high-quality SaaS based data platform.Design and implement data pipelines with a clear focus on data quality and reliability.Partner with both Product Management and stakeholders, as well as both technical and non-technical team members to deliver our vision, roadmap, and data strategy in addition to innovative client solutions.Act as an advocate for development best practices including technical design reviews, implementing test plans, test driven development, monitoring/alerting, peer code reviews, and documentation.Contribute to our DevOps culture and participate in ownership of our designs through production operations.Support the ongoing maintenance and operations of the data platform.Experience8+ years of experience in software engineering with a data focus, working in a fast-paced, agile environment5+ years of experience writing, debugging and refining database queries5+ years of experience with object oriented languages (preferably Python and C# .Net)5+ years of experience building or maintaining cloud infrastructure and services (preferably AWS)3+ years experience automating repetitive tasks (like setups, developer onboarding, support, moving data, etc.)Technical SkillsExperience with various orchestration and batch processing technologies like Apache AirflowProficiency in Snowflake and MS SQL.Proficiency in Python and C#. Both are required to be successful in this roleStrong experience with containerization such as DockerFamiliarity with monitoring tools for data pipeline performance such as New RelicExperience developing against APIs and building scalable systems.Experience with writing unit tests using frameworks such as PyTest for quality assurance.Understanding architectural differences between streaming and batch-oriented integrationsSoft SkillsStrong desire to support the team through improving internal tooling and processesProactive and self-motivated with a willingness to learn and adapt.Strong attention to detail and problem-solving abilities.Strong written and verbal English skills, and an ability to articulate technical information efficiently.Excellent organizational and time management skills.Able to work cooperatively and effectively in a hybrid agile team environment.Familiarity with Continuous Delivery systems and Lean-Agile methodologies (Scrum / Kanban)MindsetProactive go-getter. You're constantly seeking how you can be most effective in the teamAble to manage priorities and work efficiently across multiple initiatives across teamsComfortable working in a fast-paced, dynamic environmentOpen and honest communicator who can clearly indicate workload capacityProfessional Growth: Work on a variety of projects, enhancing your testing skills across different applications and technologies.Impactful Work: Play a key role in delivering high-quality solutions that shape the future of the sports and entertainment industries.Collaborative Environment: Be part of a team that values ideas, fosters a supportive atmosphere, and encourages continuous learning and improvement.Innovative Culture: Join a company committed to revolutionizing fan and stakeholder engagement through cutting-edge technology.Equal Opportunity Employer: Two Circles is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.The range below represents the low and high end of the base salary someone in this role may earn as an employee of Two Circles. Salaries will vary based on various factors including but not limited to professional and academic experience, training, associated responsibilities, and other business and organizational needs. The range listed is just one component of our total compensation package for employees. Salary decisions are dependent on the circumstances of each hire.$115,000-$130,000 CAD