Big Data Developer

2 weeks ago


Toronto, Canada Compunnel, Inc. Full time

We are seeking a highly skilled Big Data Developer with strong expertise in Spark, Scala, and Java.The ideal candidate will have a solid background in big data technologies, relational databases, and scripting in Unix environments.This role involves developing scalable data processing solutions and contributing to the design and optimization of big data systems.Key ResponsibilitiesDesign, develop, and maintain big data applications using Spark and Scala.Write efficient and complex SQL queries for data extraction and transformation.Develop and maintain backend components using Java.Work in Unix/Linux environments and create shell scripts for automation and data processing tasks.Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions.Ensure high performance and reliability of big data pipelines and applications.Utilize version control systems and CI/CD tools for streamlined development and deployment.Required Qualifications6–10 years of experience in big data technologies, with a strong focus on Spark and Scala.Proficiency in Java programming.Strong experience with SQL and relational databases.Hands-on experience with Unix/Linux environments and shell scripting.Familiarity with the Hadoop ecosystem, including Hive and other distributed systems.Experience with CI/CD tools and Git.Excellent problem-solving and communication skills.Preferred QualificationsExperience with cloud platforms such as AWS, Azure, or GCP.Knowledge of data governance and compliance standards.Exposure to Agile methodologies and tools like JIRA.CertificationsOracle Certified Professional (OCP) certification is highly desirable. #J-18808-Ljbffr


  • Big Data Developer

    2 weeks ago


    Toronto, Canada Compunnel, Inc. Full time

    We are seeking a highly skilled Big Data Developer with strong expertise in Spark, Scala, and Java.The ideal candidate will have a solid background in big data technologies, relational databases, and scripting in Unix environments.This role involves developing scalable data processing solutions and contributing to the design and optimization of big data...

  • Big Data Developer

    4 weeks ago


    Toronto, Canada Compunnel, Inc. Full time

    We are seeking a highly skilled Big Data Developer with strong expertise in Spark, Scala, and Java. The ideal candidate will have a solid background in big data technologies, relational databases, and scripting in Unix environments. This role involves developing scalable data processing solutions and contributing to the design and optimization of big data...

  • Big Data Developer

    4 weeks ago


    Toronto, Canada Compunnel, Inc. Full time

    We are seeking a highly skilled Big Data Developer with strong expertise in Spark, Scala, and Java. The ideal candidate will have a solid background in big data technologies, relational databases, and scripting in Unix environments. This role involves developing scalable data processing solutions and contributing to the design and optimization of big data...

  • Big Data Developer

    2 weeks ago


    Toronto, Ontario, Canada Tekshapers Full time

    Job Title: Big data DeveloperLocation: Toronto, ONFull TimeTotal Experience: 8-10 yearsRole Description:• We are looking for a big data developer with hands on experience on developing APIs.• The candidate should also have knowledge of Kubernetes and worked as a Java developer.• The candidate should be able to exhibit strong coding skills in above tech...

  • Big Data Developer

    1 week ago


    Toronto, Canada Pyramid Consulting, Inc Full time

    Immediate need for a talented Big Data Developer. This is a 06 months contract opportunity with long-term potential and is located in Toronto, ON (Onsite). Please review the job description below and contact me ASAP if you are interested.Job ID: 25-90079Pay Range: CAD40- CAD42/hour.  Key Responsibilities: Migrate and refactor existing Java based Spark...


  • Toronto, Canada J&M Group Full time

    OverviewJoin to apply for the AWS Big Data Developer role at J&M Group.Qualifications 7+ years of data experience in data warehouse and data lake platforms At least 2+ years of implementation experience in AWS Data Lake, S3, EMR/Glue, Python, AWS RDS, Amazon Redshift, Amazon Lake Formation, Airflow, Data Models, etc. Very strong knowledge of PySpark...


  • Toronto, Canada J&M Group Full time

    OverviewJoin to apply for the AWS Big Data Developer role at J&M Group.Qualifications 7+ years of data experience in data warehouse and data lake platforms At least 2+ years of implementation experience in AWS Data Lake, S3, EMR/Glue, Python, AWS RDS, Amazon Redshift, Amazon Lake Formation, Airflow, Data Models, etc. Very strong knowledge of PySpark...


  • Toronto, Canada J&M Group Full time

    Overview Join to apply for the AWS Big Data Developer role at J&M Group . Qualifications 7+ years of data experience in data warehouse and data lake platforms At least 2+ years of implementation experience in AWS Data Lake, S3, EMR/Glue, Python, AWS RDS, Amazon Redshift, Amazon Lake Formation, Airflow, Data Models, etc. Very strong knowledge of PySpark...

  • Big Data Consultant

    2 weeks ago


    Toronto, Canada Aarorn Technologies Inc. Full time

    We place consultants all over Canada. - **Job Title: Big Data Consultant** **Location: Toronto, ON (Thrice a week onsite)** **Full time/Contract Opportunity** **What is the opportunity?**- **Knowledge & Experience** **Must Have**: - Experience in developing/designing micro-service architecture. - Extensive experience in one of the cloud providers AWS/Azure...


  • Toronto, Canada RBC Full time

    Job Description What is the opportunity? As the Lead Big Data Developer lead the technical design and development of application systems on GFT - DaaS team. Apply extensive, in-depth knowledge, skills, and practices to perform complex assignments. Are you a talented, creative, and results-driven professional who thrives on delivering high-performing...