Cleared Data Engineer

2 weeks ago


Canada, CA OptiSource Ltd Full time

OptiSource.

We are professional, agile and our goal is to We are a fast growing company with existing funded contracts. We are always looking for talent in data engineering field. Currently we are teamed up with high end research groups and university to build innovative AI/ML solutions to be deployed in an enterprise. The opportunity allows building of cutting edge skill and ability to work with decision makers one on one.

Clearance Requirement

TS/SCI/CI Poly preferred but will entertain qualified candidates with TS Clearance

Work Locations - Reston or Washington DC

Job Overview

We are seeking a talented Data Engineer to join our team. The ideal candidate will play a crucial role in designing, developing, and maintaining data pipelines, data stores, and infrastructure to support data analytics and machine learning initiatives.

Responsibilities

- Build entity extraction capabilities within existing data pipeline or build new data pipeline

- Design and implement scalable data pipelines for both batch and real-time processing

- Develop and maintain data engineering processes to move data between systems

- Collaborate with cross-functional teams to understand data requirements and provide solutions

- Build and optimize data models for analytics and reporting purposes

- Implement data security and privacy measures

- Monitor system performance and troubleshoot issues proactively

Skills

- Proficiency in Agile methodologies for software development

- Experience implementing NLP, NLU, NLG and LLM preferred

- Experience with tools like Apache NiFi, Airflow, AWS, Spark for big data processing

- Strong understanding of data warehouse concepts and best practices. Primary data stores of interest are Postgres and SQL Server

- Knowledge of Elasticsearch and MongoDB is preferable

- Knowledge of Python for building robust applications

- Familiarity with model training techniques and analytics processes

If you are a passionate Data Engineer with a strong background in ETL, big data technologies, and software development methodologies, we encourage you to apply. Join us in driving innovation through data-driven solutions.


  • Data Engineer

    1 month ago


    Canada, CA Electric Mind inc. Full time

    As Data Engineer, you will provide hands-on expertise as it relates to data management, analytics, and business intelligence. This opportunity will allow you to utilize your unique blend of technical, software and cloud engineering experience.While working with teams in an Agile environment, you will be:Designing high quality data pipelines/architectures...

  • Data Engineer

    4 weeks ago


    Canada, CA Capgemini Full time

    As a Data Engineer, you will play a pivotal role in transforming operations by ensuring high-quality data and efficient tooling. This position involves building, maintaining, and optimizing data pipelines to drive insights, improve product solutions, and support cross-functional teams.Experience:5+ years of relevant experience in software development,...

  • Data Engineer

    3 days ago


    Canada, CA MSR Technology Group Full time

    Position: AWS Data EngineerLocation: Toronto, ONMandatory Skills: AWS, Glue, SQL, Redshift, LambdaJob Description:10+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, DevOps, Redshift.Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with...

  • Data Engineer

    1 week ago


    Canada, CA The Personal Development School Full time

    Job DescriptionThe Personal Development School is an e-learning platform in the emotional wellness space. It teaches courses on personal growth, mental health, and well-being with a focus on relationships and attachment theory. We seek a skilled Data Engineer with Data Analytics and development expertise to enhance our data infrastructure and analytics...

  • Data Engineer

    6 days ago


    Canada, CA technology& Full time

    Job Title: Data EngineerExperience Range: 8-14 yearsLocation: Canada (100% Remote, must be based within Canada)Job Type: ContractDuration: 6+ MonthsRate: CAD $60/hr - $65/hr (all-inclusive)Work Authorization: Open to all candidates legally authorized to work in Canada (No third-party candidates)Start Date: ASAPJob DescriptionAs a Data Engineer, you will play...

  • GCP Data Engineer

    4 weeks ago


    Canada, CA Avanciers Full time

    GCP Data Engineer in Toronto- Hybrid (FTE/Contract)Job Description:10+ years of experience with Data Warehouse / Data Platforms5+ years of experience creating ELT data pipelines from scratch, working with structured, semi-structured, and unstructured data and SQL.Experience building data pipelines, and GCP Services, Dataproc, BigQuery, Cloud Spanner, Cloud...


  • Canada, CA DeepRec.ai Full time

    Senior Data Engineer – ML Services and Data PipelinesLocation: RemoteEmployment Type: ContractExperience: 5+ years3 month contract + multiple extensions possibleOur client is based in the USA but employs a remote workforce. You should be available for team meetings at 8am PT and have some cross over for team collaboration in PST/ET timezone. Happy to hire...

  • Data Engineer I

    1 week ago


    Canada, CA NUMERATOR LIMITED Full time

    About the jobWe’re reinventing the market research industry. Let’s reinvent it together.At Numerator, we believe tomorrow’s success starts with today’s market intelligence. We empower the world’s leading brands and retailers with unmatched insights into consumer behavior and the influencers that drive it.Numerator is looking for a Data Engineer I...

  • Data QA Engineer

    4 weeks ago


    Canada, CA Silicontek Inc Full time

    Title: Data QA Engineer Location: Markham, Canada (Onsite, 3 days/week)Overview: We are seeking a Data QA Engineer with expertise in ETL, data warehousing, and QA automation to support enterprise-level data quality initiatives. This role requires strong analytical skills and hands-on experience in SQL, Python, and various data management tools.Key...


  • Canada, CA Samay Consulting Full time

    At Samay India, we are looking to build a Centre of Excellence for our BI team and are actively looking to hire Azure Data Engineers in both Architect and Senior level developer roles. Prior experience building pipelines and transforming data using Azure Data Factory is mandatory. Knowledge of a Cloud Datawarehouse like Azure Synapse or Snowflake is also...


  • Canada, CA Intuitive.Cloud Full time

    About us:Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes.Intuitive Superpowers:- DataOps & AI/ML- Cloud Native, AppSecOps, DevSecOps- Cloud Migration &...

  • AWS Data Engineer

    4 weeks ago


    Canada, CA Virtual Labs IT Consulting Full time

    6 years of data engineering experience with a proven track record of designing and implementing scalable ingestion framework.* 4 years hands on experience on the AWS platform using, Redshift, S3, DynamoDB, EMR serverless, Lambdas, Step Functions, etc.* Proficiency in ETL development and design using Python, PySpark, Big Data (Hadoop/SPARK)* Strong SQL...

  • ETL data engineer

    2 weeks ago


    Canada, CA HCLTech Full time

    Required Skills 5-8 years’ experience as Data Engineer Specializes in ETL (Extract, Transform, Load) using ETL tools DataStage (Primary), Matillion, ADF etc. Strong knowledge of relevant data query language e.g., SQL At least 3-4 years of US Healthcare Payer experience Experience in Snowflake, Netezza. Experience with Data warehousing techniques(Star...

  • Engineering Manager

    1 week ago


    Canada, CA Shopkick by Trax Full time

    The RoleEngineering ManagerAbout the roleTrax is looking for a leader to join as the Engineering Manager of our Shopper solution.The Engineer Manager Shopkick is a multidisciplinary role that reports to the VP of Engineering.As the Engineering Manager, your mission will be to hire, manage, mentor, and attain an Engineering group of top talents building a...


  • Canada, CA CloudGeometry Full time

    CloudGeometry is a Silicon Valley-based cloud-native system integrator with deep expertise in cloud migrations, platform engineering based on CNCF technology and full stack SaaS product development. We partner with industry leaders like AWS and Databricks to deliver solutions across all layers of the modern technology stack, from Generative AI to...

  • Senior Consultant

    5 months ago


    Canada, CA LevelUp Finance - An Array Company Full time

    Position: Senior Consultant - Financial & Operational Business Intelligence / Data EngineerLocation: Remote in CanadaExperience:At least 5 years of experience using SQL & Power BI in the workplace.Experience with accounting/finance, sales operations, or other data-intensive business operations is a plus.Experience in planning applications (e.g., Adaptive,...


  • Canada, CA Kerry Search Partners Full time

    Join the Frontlines of Blockchain Innovation as a Principal Software Engineer: Real-time Data Analytics and Blockchain! Are you passionate about pushing the boundaries of blockchain technology? Our client, a cutting-edge data company specializing in real-time analytics for decentralized applications (dApps), is looking for an exceptional Technical Lead to...

  • Data Engineer

    2 weeks ago


    Canada, CA Liztek Full time

    Data Engineer - Snowflake & Guidewire Claims Center | Insurance Industry ExpertiseSummary: Experienced Data Engineer with a strong focus on Snowflake and Guidewire Claims Center in the insurance industry. Skilled in developing data solutions, optimizing data pipelines, and integrating systems to enhance claims management and data-driven decision-making.Key...

  • Senior Data Scientist

    4 weeks ago


    Canada, CA Canterr, Inc. Full time

    Job DescriptionWe are looking for advanced analytical, action-oriented, and collaborative individuals that can translate business problems to actionable insights and data driven solutions to influence operational results. Successful individuals in this role excel at both qualitative and quantitative analysis while also being eager to communicate upward and...


  • Canada, CA Net2Source Inc. Full time

    Required Skills: SQL, Python, Data Analytics , Databricks architecture, Unity Catalog, Collibra data catalogue and data governance modules Candidate should be comfortable working in onshore and offshore model. Required Skills / Job Description:Role Overview:This role will be responsible for translating business needs into technical requirements, managing...