Senior Data Engineer

1 week ago

Fredericton, New Brunswick, Canada Appcast Inc Full time

Job Description

The Senior Data Engineer will serve as a liaison between the Appcast core development team and downstream analysts on the Data and Insights team. The senior data engineer sets up the data engineering infrastructure, using the tools of your choice. From the architecture you establish, you will then code automated processes that extract data from disparate sources; efficiently build and manage transformations into a cloud data warehouse; and build pipelines that load data into tools used by economists, data scientist, data analysts, and many other stakeholders. SQL and Python/R skills are a must. As is extensive experience managing data warehouses and ELT/ETL processes in an OLAP database.

Job Responsibilities

Move data between systems:

Extraction – Appcast has several disparate internal proprietary, external proprietary and external public sources that all serve our customers in several ways. A senior data engineer's primary job is to build automated processes that extract data from these disparate sources for downstream use by data analysts. Transform – The senior data engineer will transform data from disparate sources into distinct tables using a relational data model, so that analysts can pull them together in one unified workflow. Load – The senior data engineer will need to load the new tables into a cloud data warehouse using efficient, low-latency methods.

Manage cloud data warehouse:

Monitor performance – As data needs grow, the senior data engineer will need to monitor essential performance queries used by downstream analysts to ensure data is being delivered in a timely manner that does not cause slowdowns. Data quality – Ensuring both internal and external data sources are accurate and up to date to provide the best quality for our clients and media partners.

Serve data to downstream users ("democratize data"):

Liaison with the Appcast core software development team on data extraction from its proprietary database. Data visualization/dashboards - Partner with data analysts to ensure BI tools (e.g., Tableau) are accurate and up to date. Data permissions/access - Manage the onboarding and offboarding of data permissions, who is given access to the cloud data warehouse and ensuring proper security protocols are being followed.

Set data strategy for company:

Control cost – Work with procurement specialists to keep negotiated contracts controlled with external data vendors; research/keep up to date with new data vendors that can provide Appcast with a competitive advantage in our competitive market Data awareness/education - Educate analysts on basic data "hygiene" on how to manage and clean data, and where to access data sources Data security and governance – Develop a deep understanding of Appcast data, work with internal stakeholders to decide on what data is proper to share with clients/media due to sample size and quality Pioneer the adoption of sophisticated ETL/ELT frameworks and platforms such as Apache Airflow and DBT to enhance data workflow automation. Serve as the primary senior data engineering expert, advising senior management and other internal stakeholders on technological advancements and strategic investments in data infrastructure.

Qualifications

Expert proficiency in writing SQL queries Expert proficiency in a data engineering programming language (e.g. Python, R, Scala) Expert proficiency at managing data warehouses and ETL/ELT/OLAP processes Background in data modeling and distributed data systems Strong problem-solving skills and attention to detail Excellent communication and collaboration skills Experience with streaming data platforms like Amazon Kinesis or Apache Kafka Implement and manage complex data systems like Apache Spark for efficient data storage and computation. Familiarity with BI tools like Tableau, Shiny or PowerBI is a plus

Education and Experience

Bachelor's degree (or higher) in Computer Science, Information Technology, or a related field And, 8+ years of experience in data engineering Expert experience in writing SQL queries Strong experience in writing Python, R, and/or Scala code Strong experience in managing data warehouses and ETL/ELT/OLAP processes Experience with PostgreSQL, Tableau, or AWS tools is a plus Experience with big data technologies like Apache Spark is a plus

Travel Requirements

Regular travel is not necessary for this position.

Additional Information

Appcast recognized as one of Inc Magazine's "Best Workplaces" for 2021 & 2022

We're the best at what we do. We're the global leader in programmatic recruitment advertising. With advanced technology, unmatched market data and a team of the industry's best recruitment marketers. We have an amazing culture driven by great people. Headquartered in Lebanon, N.H. with offices in the U.S., Canada and Europe, Appcast is part of the Stepstone group. To better understand our company culture, read and check out on our website. We take care of our employees. We're dedicated to creating an inviting environment where individuals from diverse backgrounds can thrive and develop. We believe in providing competitive compensation and comprehensive benefits, ensuring our team can support their loved ones and one another. We enjoy fostering a sense of community through dedicated employee networks, fun gatherings, delicious food, and even welcoming furry friends into our workspace. We live our values each day including volunteering and giving back to our communities.

  • Senior Engineer

    5 days ago

    Fredericton, New Brunswick, Canada Unreal Gigs Full time

    About the Role:We are looking for skilled senior engineers with a diverse skill set to be part of our team. We focus on creating dependable web services, especially our trading API, which supports over 50 investment apps globally. Since our API involves real money, ensuring continuous uptime and trustworthiness is vital. Currently, we collaborate with 25...

  • Senior Environmental Engineer

    19 hours ago

    Fredericton, New Brunswick, Canada Englobe Corp. Full time

    Your EmployerDare to join Englobe At nearly 3,000 people, Englobe is one of Canada's premier firms specializing in professional engineering services, environmental sciences, and soil and biomass treatment. With offices located across Canada, the United Kingdom and France, we are conveniently located to support large- and small-scale projects, through...

  • Senior Environmental Engineer

    3 weeks ago

    Fredericton, New Brunswick, Canada Englobe Full time

    Job Description Your EmployerDare to join Englobe At nearly 3,000 people, Englobe is one of Canada's premier firms specializing in professional engineering services, environmental sciences, and soil and biomass treatment. With offices located across Canada, the United Kingdom and France, we are conveniently located to support large- and small-scale...

  • Senior Environmental Engineer

    2 months ago

    Fredericton, New Brunswick, Canada Englobe Full time

    Job Description Your EmployerDare to join Englobe At nearly 3,000 people, Englobe is one of Canada's premier firms specializing in professional engineering services, environmental sciences, and soil and biomass treatment. With offices located across Canada, the United Kingdom and France, we are conveniently located to support large- and small-scale...

  • Structural Engineer

    3 weeks ago

    Fredericton, New Brunswick, Canada Meridia Recruitment Solutions Full time

    Job Title: Senior Structural EngineerLocation: Fredericton, New Brunswick or Moncton, New BrunswickTP-17729Meridia is excited to partner with GEMTEC, a leading Engineering Firm with offices across Atlantic Canada and Ontario, in recruiting a motivated and skilled Intermediate or Senior Structural Engineer to become a pivotal part of their team.GEMTEC...

  • Structural Engineer

    1 month ago

    Fredericton, New Brunswick, Canada Meridia Recruitment Solutions Full time

    Job Title: Senior Structural EngineerLocation: Fredericton, New Brunswick or Moncton, New BrunswickTP-17729Meridia is excited to partner with GEMTEC, a leading Engineering Firm with offices across Atlantic Canada and Ontario, in recruiting a motivated and skilled Intermediate or Senior Structural Engineer to become a pivotal part of their team.GEMTEC...

  • Structural Engineer

    1 week ago

    Fredericton, New Brunswick, Canada Meridia Recruitment Solutions Full time

    Job Title: Senior Structural EngineerLocation: Fredericton, New Brunswick or Moncton, New BrunswickTP-17729Meridia is excited to partner with GEMTEC, a leading Engineering Firm with offices across Atlantic Canada and Ontario, in recruiting a motivated and skilled Intermediate or Senior Structural Engineer to become a pivotal part of their team.GEMTEC...

  • Senior Scientist Research Computing

    1 week ago

    Fredericton, New Brunswick, Canada Rutgers University Full time

    Below you will find the details for the position including any supplementary documentation and questions you should review before applying for the opening. To apply for the position, please click the Apply for this Job link/button. If you would like to bookmark this position for later review, click on the Bookmark link. If you would like to print a copy of...

  • Data Management Lead

    1 week ago

    Fredericton, New Brunswick, Canada New Brunswick Liquor Co Full time

    Data Management Lead (3-year term)Alcool NB Liquor / Cannabis NBAbout the position Alcool NB Liquor is embarking on a multiyear business transformation project, including the implementation of Microsoft D365.We are seeking a Data Management Lead to develop, execute, and monitor a Data Management Program for ANBL and Cannabis NB. They will act as a Subject...

  • Senior SQL Developer

    1 week ago

    Fredericton, New Brunswick, Canada GTT, LLC Full time

    Senior SQL DeveloperContract Duration 12 MonthsJob Overview:The primary focus of the Senior Programmer/SQL Developer position under the terms of this statement will be to work with the team members to support the DSP (Data Sharing Platform). DSP is a collection of Health Data Sources that are used to conduct analysis and produce reports.Deliverables:Our...

  • Specialist, Radio Engineering

    3 weeks ago

    Fredericton, New Brunswick, Canada Bell Full time

    Req Id: At Bell, we do more than build world-class networks, develop innovative services and create original multiplatform media content – we're revolutionizing how Canadians communicate. If you're ready to bring game-changing ideas to life and join a community that values bold ideas, professional growth and employee wellness, we want you on the Bell...

  • Specialist, Radio Engineering

    1 month ago

    Fredericton, New Brunswick, Canada Bell Full time

    Req Id: At Bell, we do more than build world-class networks, develop innovative services and create original multiplatform media content – we're revolutionizing how Canadians communicate. If you're ready to bring game-changing ideas to life and join a community that values bold ideas, professional growth and employee wellness, we want you on the Bell...

  • Marine Structural Engineer

    1 week ago

    Fredericton, New Brunswick, Canada Meridia Recruitment Solutions Full time

    Role Description Reporting to the Senior Department Manager/Structural Division Manager, the Marine Structural Engineer will provide expertise for civil infrastructure projects such as ports, harbours, and bridges. Your responsibilities will include project management of ongoing initiatives including scheduling and budgeting. Within a multi-disciplinary...

  • Sr. Software Engineer

    1 week ago

    Fredericton, New Brunswick, Canada CrowdStrike, Inc. Full time

    About the Role:CrowdStrike is looking for a Senior Software Engineer to join our growing Content Research and Integration team within the EndPoint Protection Content group, which focuses on security related endpoint development on the Windows, macOS, and Linux platforms.The Endpoint Protection Content group plays a central role in fulfilling CrowdStrike's...

  • Senior Scientist, MSTG

    1 week ago

    Fredericton, New Brunswick, Canada SUN PHARMA Full time

    Job Title: Senior Scientist, MSTG Summary: Senior Scientist, MSTG, performs process development studies, Exhibit batch and process qualification activities. This position also prepares technical documentation to support development and validation program at Sun Pharma. This position provides technical support to Manufacturing and Quality department....

  • Senior Underwriting Consultant

    3 weeks ago

    Fredericton, New Brunswick, Canada Equitable Full time

    Senior Underwriting Consultant - Large Case New Brunswick, Canada Req #2106 Wednesday, May 22, At Equitable, we realize that your work life is not just about performing a job; it's about being part of a workplace that helps you grow and reach your full potential. Within our friendly and collaborative work environment, we recognize that the key to our...

  • Senior Underwriting Consultant

    1 month ago

    Fredericton, New Brunswick, Canada Equitable Full time

    Senior Underwriting Consultant - Large Case New Brunswick, Canada Req #2106 Wednesday, May 22, At Equitable, we realize that your work life is not just about performing a job; it's about being part of a workplace that helps you grow and reach your full potential. Within our friendly and collaborative work environment, we recognize that the key to our...

  • Intermediate Environmental Engineer

    3 weeks ago

    Fredericton, New Brunswick, Canada Englobe Corp. Full time

    Your EmployerDare to join Englobe At nearly 3,000 people, Englobe is one of Canada's premier firms specializing in professional engineering services, environmental sciences, and soil and biomass treatment. With offices located across Canada, the United Kingdom and France, we are conveniently located to support large- and small-scale projects, through...

  • Intermediate Environmental Engineer

    1 month ago

    Fredericton, New Brunswick, Canada Englobe Corp. Full time

    Your EmployerDare to join Englobe At nearly 3,000 people, Englobe is one of Canada's premier firms specializing in professional engineering services, environmental sciences, and soil and biomass treatment. With offices located across Canada, the United Kingdom and France, we are conveniently located to support large- and small-scale projects, through...

  • Intermediate Environmental Engineer

    1 week ago

    Fredericton, New Brunswick, Canada Englobe Full time

    We offer A full range of benefits (group insurance with shared costs upon hiring, group RRSP); A telemedicine virtual healthcare service; An annual reimbursement of sports expenses; Opportunities for skills development; Flexible hours and ability to compress working hours; Internal policy to encourage teleworking. Choose the path of impact. Join...