Big Data Developer

1 week ago


Toronto, Canada Compunnel, Inc. Full time

We are seeking a highly skilled Big Data Developer with strong expertise in Spark, Scala, and Java.

The ideal candidate will have a solid background in big data technologies, relational databases, and scripting in Unix environments.

This role involves developing scalable data processing solutions and contributing to the design and optimization of big data systems.

Key Responsibilities

- Design, develop, and maintain big data applications using Spark and Scala.
- Write efficient and complex SQL queries for data extraction and transformation.
- Develop and maintain backend components using Java.
- Work in Unix/Linux environments and create shell scripts for automation and data processing tasks.
- Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions.
- Ensure high performance and reliability of big data pipelines and applications.
- Utilize version control systems and CI/CD tools for streamlined development and deployment.

Required Qualifications

- 6–10 years of experience in big data technologies, with a strong focus on Spark and Scala.
- Proficiency in Java programming.
- Strong experience with SQL and relational databases.
- Hands-on experience with Unix/Linux environments and shell scripting.
- Familiarity with the Hadoop ecosystem, including Hive and other distributed systems.
- Experience with CI/CD tools and Git.
- Excellent problem-solving and communication skills.

Preferred Qualifications

- Experience with cloud platforms such as AWS, Azure, or GCP.
- Knowledge of data governance and compliance standards.
- Exposure to Agile methodologies and tools like JIRA.

Certifications

- Oracle Certified Professional (OCP) certification is highly desirable.

#J-18808-Ljbffr


  • Big Data Developer

    1 week ago


    Toronto, Canada Compunnel, Inc. Full time

    We are seeking a highly skilled Big Data Developer with strong expertise in Spark, Scala, and Java. The ideal candidate will have a solid background in big data technologies, relational databases, and scripting in Unix environments. This role involves developing scalable data processing solutions and contributing to the design and optimization of big data...

  • Big Data Developer

    2 weeks ago


    Toronto, Canada Pyramid Consulting, Inc Full time

    Immediate need for a talented Big Data Developer. This is a 06 months contract opportunity with long-term potential and is located in Toronto, ON (Onsite). Please review the job description below and contact me ASAP if you are interested.Job ID: 25-90079Pay Range: CAD40- CAD42/hour.  Key Responsibilities: Migrate and refactor existing Java based Spark...

  • Big Data Developer

    18 hours ago


    Toronto, Ontario, Canada Pyramid Consulting, Inc Full time

    Immediate need for a talentedBig Data Developer.This is a06+ months contractopportunity with long-term potential and is located inToronto, ON (Onsite). Please review the job description below and contact me ASAP if you are interested.Job ID: Pay Range: CAD40- CAD42/hour on T4.Key Responsibilities:Migrate and refactor existing Java based Spark modules to...


  • Toronto, Ontario, Canada BULL-IT SOLUTIONS LTD Full time

    Tips: Provide a summary of the role, what success in the position looks like, and how this role fits into the organization overall.ResponsibilitiesTotal Experience: 7-12 yearsRole Description:• Design high quality deliverables adhering to business requirements with defined standards and design principles, patterns• Develop and maintain highly scalable,...


  • Toronto, Ontario, Canada Vybog Full time

    OverviewAre you interested in building the next-generation platform that handlespetabytes of dataand powersdata insight creationusing cutting-edgedata science technologies?Are you excited about leveragingBig Data,AI / Machine Learning, andData Analyticsto deliver actionable insights?We are adynamic team of top-notch engineersdedicated to making a dent in...


  • Toronto, Canada J&M Group Full time

    Overview Join to apply for the AWS Big Data Developer role at J&M Group . Qualifications 7+ years of data experience in data warehouse and data lake platforms At least 2+ years of implementation experience in AWS Data Lake, S3, EMR/Glue, Python, AWS RDS, Amazon Redshift, Amazon Lake Formation, Airflow, Data Models, etc. Very strong knowledge of PySpark...

  • Big Data Developer

    4 weeks ago


    Toronto, ON, Canada Tata Consultancy Services Full time

    Inclusion without Exception: Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity is reflected in our...


  • Toronto, Canada Triton Full time

    Are you a visionary leader with a passion for data and emerging technologies? Do you thrive in collaborative environments where innovation, team growth, and technical excellence go hand in hand? Join us as we redefine how audio streaming data powers our products and insights. We are seeking a Director of Big Data & Machine Learning Engineering to lead and...


  • Toronto, Canada Triton Full time

    Are you a visionary leader with a passion for data and emerging technologies? Do you thrive in collaborative environments where innovation, team growth, and technical excellence go hand in hand? Join us as we redefine how audio streaming data powers our products and insights. We are seeking a Director of Big Data & Machine Learning Engineering to lead and...


  • Toronto, Canada Triton Full time

    Are you a visionary leader with a passion for data and emerging technologies? Do you thrive in collaborative environments where innovation, team growth, and technical excellence go hand in hand? Join us as we redefine how audio streaming data powers our products and insights. We are seeking a Director of Big Data & Machine Learning Engineering to lead and...