Big Data Developer

1 day ago

Toronto, Canada Insight Global Full time

The Big Data Engineer is responsible for architecting, developing, and maintaining enterprise‑scale data platforms that support analytics, operational reporting, and machine learning initiatives. This role requires deep technical expertise in distributed systems, cloud platforms, and data modeling, combined with strong communication and leadership capabilities. Responsibilities Design and implement large‑scale ETL/ELT pipelines using Python, Spark, and distributed processing frameworks Develop and maintain big data infrastructure leveraging Hadoop, Spark, Kafka, and Kafka Streams Architect cloud‑native data solutions on AWS or Azure, including serverless components Build and optimize Snowflake data warehouses using dimensional modeling best practices Conduct data discovery and source analysis to support new integrations and transformations Model complex datasets using normalized, denormalized, star, and snowflake schemas Integrate external systems through RESTful APIs and automated ingestion frameworks Implement DevOps practices including CI/CD, containerization, and orchestration Develop real‑time streaming applications using Kafka, Storm, Kinesis, or Pub/Sub Operationalize machine learning models in collaboration with data science teams Optimize performance across queries, pipelines, and distributed workloads Troubleshoot and resolve complex data issues across upstream and downstream systems Maintain comprehensive documentation for data pipelines, models, and integrations Qualifications Advanced SQL proficiency for investigation and optimization Experience with cloud platforms (AWS or Azure) Knowledge of Snowflake and dimensional modeling Experience with DevOps tooling (CI/CD, Docker, Kubernetes) Familiarity with ML frameworks (TensorFlow, PyTorch) Strong debugging and analytical skills Leadership and mentorship Effective communication with technical and non‑technical audiences #J-18808-Ljbffr

  • Big Data Developer

    2 days ago

    Toronto, Canada Insight Global Full time

    The Big Data Engineer is responsible for architecting, developing, and maintaining enterprise‑scale data platforms that support analytics, operational reporting, and machine learning initiatives. This role requires deep technical expertise in distributed systems, cloud platforms, and data modeling, combined with strong communication and leadership...

  • Lead Big Data Developer, GFT

    4 weeks ago

    Toronto, Canada RBC Full time

    Job Description What is the opportunity? As the Lead Big Data Developer lead the technical design and development of application systems on GFT - DaaS team. Apply extensive, in-depth knowledge, skills, and practices to perform complex assignments. Are you a talented, creative, and results-driven professional who thrives on delivering high-performing...

  • Big Data Consultant

    2 days ago

    Toronto, Canada Aarorn Technologies Inc. Full time

    We place consultants all over Canada. - **Job Title: Big Data Consultant** **Location: Toronto, ON (Thrice a week onsite)** **Full time/Contract Opportunity** **What is the opportunity?**- **Knowledge & Experience** **Must Have**: - Experience in developing/designing micro-service architecture. - Extensive experience in one of the cloud providers AWS/Azure...

  • Lead Big Data Developer, GFT

    2 weeks ago

    Toronto, Ontario, Canada RBC Full time

    Job DescriptionWhat is the opportunity?As the Lead Big Data Developer lead the technical design and development of application systems on GFT - DaaS team. Apply extensive, in-depth knowledge, skills, and practices to perform complex assignments.Are you a talented, creative, and results-driven professional who thrives on delivering high-performing...

  • Data Engineer

    2 weeks ago

    Toronto, Canada Scotiabank Full time

    A leading Canadian bank is seeking a Data Engineer in Toronto to contribute to their data integration solutions. The role requires extensive experience in software development and a deep understanding of Big Data technologies. Candidates should have strong skills in Agile development, data management, and analytics, coupled with hands-on experience with...

  • Data Engineer

    3 days ago

    Toronto, Canada Scotiabank Full time

    A leading Canadian bank is seeking a Data Engineer in Toronto to contribute to their data integration solutions. The role requires extensive experience in software development and a deep understanding of Big Data technologies. Candidates should have strong skills in Agile development, data management, and analytics, coupled with hands-on experience with...

  • Big Data Etl

    3 days ago

    Toronto, Canada virtusa Full time

    **Job Title**: Big Data ETL + Python/PySpark Tester **Location**: Toronto, ON, Canada **Industry**: Big Data, Cloud Computing, ETL Testing **Required Skills and Qualifications**: - **9+ years** experience in Software Development Life Cycle (SDLC) and Software Testing Life Cycle (STLC). - Strong knowledge of **Big Data** technologies like...

  • Lead Data Platform Engineer

    1 week ago

    Toronto, Canada Endava Full time

    A global technology consultancy in Toronto is looking for a senior Java Developer with extensive experience in data engineering and Capital Markets. You will create data pipelines, ensure data quality, and design robust applications. Ideal candidates have 10+ years in Java, familiarity with big data tools, and a passion for tech innovation. The role promotes...

  • Lead Data Platform Engineer

    2 weeks ago

    Toronto, Canada Endava Full time

    A global technology consultancy in Toronto is looking for a senior Java Developer with extensive experience in data engineering and Capital Markets. You will create data pipelines, ensure data quality, and design robust applications. Ideal candidates have 10+ years in Java, familiarity with big data tools, and a passion for tech innovation. The role promotes...

  • Staff Product Data Analyst

    3 weeks ago

    Toronto, Canada Big Viking Full time

    Important: This a full-time, hybrid role for Ontario-based employees only. The successful candidate will be required to work from our Toronto office (Queens Quay West) for a minimum of 3 days per week. About Us: Making fans - That’s what we’re all about! Since our humble beginnings in 2011, these two words have driven Big Viking Games to become the...