Data Engineering Consultant

Found in: Talent CA C2 - 7 days ago


Halifax Regional Municipality, Canada CGI Full time

Position Description:

As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines, databases, and analytics solutions.
Your expertise in data engineering tools and platforms will drive the efficient processing, storage, and retrieval of data.
You’ll collaborate with data scientists, analysts, and other stakeholders to ensure data availability, quality, and reliability.

Your future duties and responsibilities:

Responsibilities:

Data Pipeline Development:
•Design, implement, and optimize data pipelines for ingesting, transforming, and loading data from various sources.
•Use ETL (Extract, Transform, Load) processes to move and transform data efficiently.
•Ensure data consistency, accuracy, and timeliness.
Database Management:
•Work with relational databases (such as PostgreSQL, MySQL, or Oracle) and NoSQL databases (like MongoDB or Cassandra).
•Design schema, create tables, and manage data storage.
•Optimize database performance and query execution.

Tech Stack:
•Programming Languages: Proficiency in Python, Java, or Scala for data processing and scripting.
•Big Data Technologies: Familiarity with Apache Hadoop, Spark, and Kafka.
•Data Warehousing: Experience with data warehousing solutions (e.g., Amazon Redshift, Google BigQuery, Snowflake).
•Cloud Platforms:
-Google Cloud Platform (GCP):
-Designing and deploying scalable, highly available, and fault-tolerant systems on GCP.
-Managing and provisioning GCP infrastructure using Infrastructure as Code tools (e.g., Terraform, Google Cloud Deployment Manager).
-Automating GCP operations using scripting languages (Python, Bash) and GCP SDKs or APIs
Collaboration:
•Work closely with data scientists and analysts to understand their data requirements.
•Collaborate with cross-functional teams to ensure seamless integration of data solutions.
•Participate in architectural discussions and provide technical guidance.

Required qualifications to be successful in this role:

Qualifications:
Education: Bachelor’s or Master’s degree in Computer Science, Information Technology, or related fields.

Experience:
•Minimum 3-5 years of experience in data engineering.
•Proficiency in SQL and database design.
•Familiarity with data modeling and schema design.
Desired Skills:
•Data Security: Understanding of data security best practices.
•Monitoring and Troubleshooting: Ability to monitor and troubleshoot data pipelines using tools like GCP Stackdriver and Cloud Monitoring.
•Automation: Experience automating data processing tasks using scripting languages (Python, Bash).

#LI-MT1

Skills:

Data Analysis Data Warehousing Database
  • Senior Data Engineering Consultant

    Found in: Talent CA C2 - 5 days ago


    Halifax Regional Municipality, Canada CGI Full time

    Position Description: Principal Quant Data Engineering The Role The Asset Management Quant Research Engineering team is looking for a Principal Data Engineering who wishes to take on the challenge of building a world-class data operation. We are looking for individuals who bring expertise in data onboarding and quality best practices and the drive to...

  • Cloud Data Engineer

    Found in: Talent CA C2 - 7 days ago


    Halifax Regional Municipality, Canada CGI Full time

    Position Description: Location: Hybrid/GTA Job Type: Full-Time We are seeking a highly skilled and experienced Cloud Data Engineer to join our dynamic team. In this role, you will play a crucial role in designing and implementing cutting-edge data solutions using a variety of technologies and platforms. Your future duties and responsibilities: ...

  • Senior Data Engineer

    Found in: Talent CA 2A C2 - 5 days ago


    Halifax Regional Municipality, Canada TEEMA Full time

    Data Engineer- 6-9 month contract roleLocation: Remote/Work can be primarily remote with some onsite visits will be required (for meetings)QualificationsExperience working as a data engineer for data integration, migration, or extraction in a data warehouse/data lake context. A minimum of two (2) years of experience in roles related to digital health....


  • Halifax Regional Municipality, Canada CGI Full time

    Position Description: CGI is expanding its Health and Life Sciences Team in the Atlantic Region. We are seeking an experienced Senior Consultant of Health Data, Analytics and AI with experience leading and managing medium to large-sized technology consulting and delivery projects a complex healthcare setting. Experience working with Nova Scotia Health...

  • Big Data Engineer, Data Services, GFT

    Found in: Talent CA C2 - 2 weeks ago


    Halifax Regional Municipality, Canada Royal Bank of Canada> Full time

    Job SummarySupports the development and maintenance of scalable data stores that supply big data in forms needed for business analysis. Applies experience and seasoned knowledge, skills, and practices to perform a variety of assignments.Job DescriptionWHAT IS THE OPPORTUNITY? Global Functions Technology has a transformational agenda, and we thrive on the...

  • Big Data Engineer, Data Services, GFT

    Found in: Talent CA C2 - 14 hours ago


    Halifax Regional Municipality, Canada Royal Bank of Canada> Full time

    Job SummarySupports the development and maintenance of scalable data stores that supply big data in forms needed for business analysis. Applies experience and seasoned knowledge, skills, and practices to perform a variety of assignments.Job DescriptionWHAT IS THE OPPORTUNITY? Global Functions Technology has a transformational agenda, and we thrive on the...

  • Tech Lead/Senior Data Engineer

    Found in: Talent CA C2 - 14 hours ago


    Halifax Regional Municipality, Canada LifeRaft Full time

    As a key member of our engineering department, you will lead the design, development, and implementation of innovative data solutions to enhance our platform's capabilities. Leveraging your expertise in data engineering, you will collaborate closely with cross-functional teams to architect scalable data pipelines, optimize data workflows, and drive...

  • Senior Data Engineer

    Found in: Talent CA C2 - 7 days ago


    Halifax Regional Municipality, Canada Smart TechLink Solutions Inc. Full time

    Responsibilities8+ Years in engineering solutions using PySpark and PythonStrong SQL development ExperienceExperienced in working in a Cloud environmentAble to create cohesive technology solutions using microservicesour system and implementing new featuresCollaborating with other team members in a Feature Team perspectiveDeveloping and delivering complex...

  • Software Engineer

    Found in: Jooble CA O C2 - 1 week ago


    Greater Vancouver Regional District, BC, Canada Softmax Data Inc. Full time

    Softmax Data Inc. is headquartered in the downtown core of Vancouver. We are a boutique consultancy specializing in the development of proprietary software in machine learning, data pipeline, and data analytics. We are seeking a Fullstack Developer with strong skills in backend (Rails) and frontend (React and Angular) development. The ideal software engineer...

  • Engineer Specialist

    Found in: Talent CA C2 - 7 days ago


    Halifax Regional Municipality, Canada IMP Group Full time

    Engineer Specialist Requisition ID: 694  Why Choose IMP Aerospace & Defence:IMP Aerospace & Defence is not only one of the leading companies in the Aerospace field, but we are also one of the most engaging and equality advocating companies to work for. We believe that regardless of where you work at IMP Aerospace & Defence, you are a part of our...

  • Engineer Specialist

    Found in: Talent CA C2 - 1 week ago


    Halifax Regional Municipality, Canada IMP Group Full time

    Requisition ID: 694  Why Choose IMP Aerospace & Defence: IMP Aerospace & Defence is not only one of the leading companies in the Aerospace field, but we are also one of the most engaging and equality advocating companies to work for. We believe that regardless of where you work at IMP Aerospace & Defence, you are a part of our ever-growing team. IMP...

  • Intermediate Air Quality Engineer

    Found in: Talent CA 2 C2 - 7 days ago


    Halifax Regional Municipality, Canada Appcast Full time

    Job SummaryAt AECOM, we’re delivering a better world. We believe infrastructure creates opportunity for everyone. Whether it’s improving your commute, keeping the lights on, providing access to clean water or transforming skylines, our work helps people and communities thrive.Our clients trust us to bring together the best people, ideas, technical...

  • Site Reliability Engineer

    Found in: Talent CA C2 - 7 days ago


    Halifax Regional Municipality, Canada CGI Full time

    Position Description: As a Site Reliability Engineer (SRE), you will play a critical role in ensuring the reliability, performance, and availability of our systems. Your expertise in managing infrastructure, automating processes, and implementing best practices will contribute to seamless operations. You’ll collaborate with cross-functional teams,...

  • Salesforce Technical Project Manager

    Found in: Talent CA C2 - 7 days ago


    Halifax, Canada NTT DATA Full time

    Job DescriptionAs an integral part of the services arm of the partner ecosystem, the Technical Project Managers work closely with different stakeholders through the client organization to coordinate the consultancy-side implementation team (management, subject matter experts, consultants, and developers) accordingly. This involves driving all the project...

  • Data Engineer

    5 days ago


    Halifax, Canada Government Entity Full time

    A minimum of 5 years of experience working as a data engineer for data integration, migration, or extraction in a data warehouse/data lake context.A minimum of 2 of experience in roles related to digital health.Recent experience (in the last 2 years) working with Microsoft (MS) Azure cloud-native tools, including Azure Synapse Analytics, Azure Databricks, MS...

  • Hardware Engineer

    Found in: Talent CA C2 - 1 week ago


    Halifax Regional Municipality, Canada Jaza Full time

    Company OverviewJaza is a solar energy start-up working to power Sub-Saharan Africa. We build solar-powered shops which charge batteries customers use to power their homes and businesses. Since 2022, we've achieved over 3 million battery swaps, providing approximately 225,000 people access to clean, affordable energy. We started our operations in Tanzania in...

  • Field Engineer

    Found in: Talent CA C2 - 1 week ago


    Halifax Regional Municipality, Canada Hilti Group Full time

    What's the role? * Selected candidate can reside in Halifax or Moncton * ​The role of Field Engineer provides technical support and drives the sales of specified products to salesforce and customers (buying and non-buying) consistent with Hilti’s strategy. Responsibilities include, but are not limited to, educating the design communities...

  • Senior Software Engineer

    Found in: Talent CA C2 - 7 days ago


    Halifax Regional Municipality, Canada LifeRaft Full time

    LifeRaft is looking to fill a Senior Software Engineering role to help us continue to grow and enrich the platform our customers use to keep their people and assets safe.Based out of Nova Scotia, Canada, LifeRaft was incorporated in 2014 with a clear objective to advance corporate security. We pride ourselves on our innovative spirit and determination to...

  • Data Engineer

    Found in: Whatjobs CA C2 - 5 days ago


    Halifax, Canada Government Entity Full time

    A minimum of 5 years of experience working as a data engineer for data integration, migration, or extraction in a data warehouse/data lake context. A minimum of 2 of experience in roles related to digital health. Recent experience (in the last 2 years) working with Microsoft (MS) Azure cloud-native tools, including Azure Synapse Analytics, Azure Databricks,...

  • Data Engineer

    Found in: Appcast CA C2 Glassdoor - 6 days ago


    Halifax, Canada Government Entity Full time

    A minimum of 5 years of experience working as a data engineer for data integration, migration, or extraction in a data warehouse/data lake context.A minimum of 2 of experience in roles related to digital health.Recent experience (in the last 2 years) working with Microsoft (MS) Azure cloud-native tools, including Azure Synapse Analytics, Azure Databricks, MS...