Big Data Developer
1 week ago
We are seeking a highly skilled Big Data Developer with strong expertise in Spark, Scala, and Java.
The ideal candidate will have a solid background in big data technologies, relational databases, and scripting in Unix environments.
This role involves developing scalable data processing solutions and contributing to the design and optimization of big data systems.
Key Responsibilities
- Design, develop, and maintain big data applications using Spark and Scala.
- Write efficient and complex SQL queries for data extraction and transformation.
- Develop and maintain backend components using Java.
- Work in Unix/Linux environments and create shell scripts for automation and data processing tasks.
- Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions.
- Ensure high performance and reliability of big data pipelines and applications.
- Utilize version control systems and CI/CD tools for streamlined development and deployment.
Required Qualifications
- 6–10 years of experience in big data technologies, with a strong focus on Spark and Scala.
- Proficiency in Java programming.
- Strong experience with SQL and relational databases.
- Hands-on experience with Unix/Linux environments and shell scripting.
- Familiarity with the Hadoop ecosystem, including Hive and other distributed systems.
- Experience with CI/CD tools and Git.
- Excellent problem-solving and communication skills.
Preferred Qualifications
- Experience with cloud platforms such as AWS, Azure, or GCP.
- Knowledge of data governance and compliance standards.
- Exposure to Agile methodologies and tools like JIRA.
Certifications
- Oracle Certified Professional (OCP) certification is highly desirable.
#J-18808-Ljbffr
-
Big Data Developer
1 week ago
Toronto, Canada Compunnel, Inc. Full timeWe are seeking a highly skilled Big Data Developer with strong expertise in Spark, Scala, and Java. The ideal candidate will have a solid background in big data technologies, relational databases, and scripting in Unix environments. This role involves developing scalable data processing solutions and contributing to the design and optimization of big data...
-
Big Data Developer
2 weeks ago
Toronto, Canada Pyramid Consulting, Inc Full timeImmediate need for a talented Big Data Developer. This is a 06 months contract opportunity with long-term potential and is located in Toronto, ON (Onsite). Please review the job description below and contact me ASAP if you are interested.Job ID: 25-90079Pay Range: CAD40- CAD42/hour. Key Responsibilities: Migrate and refactor existing Java based Spark...
-
Big Data Developer
18 hours ago
Toronto, Ontario, Canada Pyramid Consulting, Inc Full timeImmediate need for a talentedBig Data Developer.This is a06+ months contractopportunity with long-term potential and is located inToronto, ON (Onsite). Please review the job description below and contact me ASAP if you are interested.Job ID: Pay Range: CAD40- CAD42/hour on T4.Key Responsibilities:Migrate and refactor existing Java based Spark modules to...
-
Senior big Data Developer
2 days ago
Toronto, Ontario, Canada BULL-IT SOLUTIONS LTD Full timeTips: Provide a summary of the role, what success in the position looks like, and how this role fits into the organization overall.ResponsibilitiesTotal Experience: 7-12 yearsRole Description:• Design high quality deliverables adhering to business requirements with defined standards and design principles, patterns• Develop and maintain highly scalable,...
-
Lead Big Data Developer
2 weeks ago
Toronto, Ontario, Canada Vybog Full timeOverviewAre you interested in building the next-generation platform that handlespetabytes of dataand powersdata insight creationusing cutting-edgedata science technologies?Are you excited about leveragingBig Data,AI / Machine Learning, andData Analyticsto deliver actionable insights?We are adynamic team of top-notch engineersdedicated to making a dent in...
-
AWS Big Data Developer
4 weeks ago
Toronto, Canada J&M Group Full timeOverview Join to apply for the AWS Big Data Developer role at J&M Group . Qualifications 7+ years of data experience in data warehouse and data lake platforms At least 2+ years of implementation experience in AWS Data Lake, S3, EMR/Glue, Python, AWS RDS, Amazon Redshift, Amazon Lake Formation, Airflow, Data Models, etc. Very strong knowledge of PySpark...
-
Big Data Developer
4 weeks ago
Toronto, ON, Canada Tata Consultancy Services Full timeInclusion without Exception: Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity is reflected in our...
-
Director of Development
4 weeks ago
Toronto, Canada Triton Full timeAre you a visionary leader with a passion for data and emerging technologies? Do you thrive in collaborative environments where innovation, team growth, and technical excellence go hand in hand? Join us as we redefine how audio streaming data powers our products and insights. We are seeking a Director of Big Data & Machine Learning Engineering to lead and...
-
Director of Development
4 weeks ago
Toronto, Canada Triton Full timeAre you a visionary leader with a passion for data and emerging technologies? Do you thrive in collaborative environments where innovation, team growth, and technical excellence go hand in hand? Join us as we redefine how audio streaming data powers our products and insights. We are seeking a Director of Big Data & Machine Learning Engineering to lead and...
-
Director of Development
4 weeks ago
Toronto, Canada Triton Full timeAre you a visionary leader with a passion for data and emerging technologies? Do you thrive in collaborative environments where innovation, team growth, and technical excellence go hand in hand? Join us as we redefine how audio streaming data powers our products and insights. We are seeking a Director of Big Data & Machine Learning Engineering to lead and...