Data Engineer

1 week ago

Vancouver, Canada Rose International Full time

Date Posted: 09/05/2024

Hiring Organization: Rose International

Position Number: 470469

Job Title: Data Engineer

Job Location: Vancouver, BC, Canada, V5K 0A1

Work Model: Hybrid

Shift: Hybrid - Onsite 3 days a week.

Employment Type: Temporary

Estimated Duration (In months): 16

Min Hourly Rate($): 60.00

Max Hourly Rate($): 65.00

Must Have Skills/Attributes: Agile, AWS, Big Data, Data Engineer, Java

Nice To Have Skills/Attributes: Apache Spark, Databricks, Microservices, Python, Scala, Web Services

Job Description

***Only qualified Data Engineer candidates located near the Vancouver, Canada area to be considered due to the position requiring an onsite presence***


Our client is seeking a Data Engineer who thrives on testing and maintaining large data processing systems, primarily in the Spark framework using Scala. Our ideal candidate will understand the challenges of working with data at scale and have a firm knowledge of algorithms and processing complexity.

Our team is a mix of software engineers and data analysts working to ensure our inputs, algorithms, and publishing artifacts are of the highest quality and efficiency.

Our team is a mix of software engineers and data analysts working to ensure our inputs, algorithms, and publishing artifacts are of the highest quality and efficiency. Our output is critical to the accuracy of our Risk Analysis APIs which power top e-commerce sites. Constant improvement and innovation are designed into our process.


Qualifications:

• Ability to create good acceptance and integration test automation scripts and integrate with Continuous integration (Jenkins/Bamboo) and code coverage tools (Sonar) to ensure 80% or higher code coverage

• A proactive attitude and the knowledge and ability to help influence and shape the QA process to drive the team to deploy quality data

• Experience working with cloud-based server environments (AWS)

• Specific language knowledge: Scala, Java, Python

• Experience with some of the big data technologies like Apache Spark, Airflow and Databricks

• Experience using team collaboration and bug tracking tools (Jira, etc.)

• Self-motivated learner willing to take on challenging problems

• Aptitude to learn new languages and technologies as necessary

• Passion for diving deep in data and insights

• In-depth knowledge of one or more Internet protocols

• Experience with one or more strongly typed programming languages

• Bachelor’s (BS) degree in Computer Science, related degree, or equivalent


TOP Required Skills:

• Develop big data processing systems using Apache Spark, Airflow, Databricks, AWS and related technologies

• Understand Continuous Integration (CI) and Delivery (CD) concepts, and capabilities to support automation, pipelines, virtualization, and containerization

• Fluency in one or more languages like Scala, Java, Python etc.


Desired/nice to have technical skills:

• Knowledge of Microservices and scaling techniques

• Experience using web service APIs


Data Engineer Responsibilities:

• Write and own technical test design and execution as a member of an Agile-based Scrum team with an emphasis on automation, tooling, and scripting skills

• Assist in a technical test role to help drive data quality and to build, implement and execute tests and automation improvements for our core processes and publishing cycle

• Work closely with software engineers on the team in expanding test automation framework and test coverage, and on assigned projects to assist in testing and implementation tasks

• This is a technical position and requires writing, interpreting, and reviewing both test and application code

• Understand the big picture and end-to-end logical architecture of systems and various Graph core processes

• Documents test strategies and test plans; translates complex system requirements and specs into test requirements and testing methods

• Be able and willing to take an innovative approach towards testing and troubleshooting new technologies primarily focused on Big Data

• Be an integral part of the Agile SAFe scrum, sprint planning and backlog grooming sessions

• Communicate, collaborate, and work effectively in a global environment.

• Understand the use of Client technology policies in everyday work

• Demonstrate active learning and sharing of software practices via Guild/Engineering community initiatives


  • **Only those lawfully authorized to work in the designated country associated with the position will be considered.**


  • **Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client’s business needs and requirements.**


Benefits:

For information and details on employment benefits offered with this position, please visit here. Should you have any questions/concerns, please contact our HR Department via our secure website.

California Pay Equity:

For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here.

Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.

If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department.

Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).

  • Senior Data Engineer

    3 days ago

    Vancouver, British Columbia, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our Promotions team at Amazon. As a key member of our team, you will be responsible for designing, processing, and managing large datasets across various data platforms.Key ResponsibilitiesDesign and implement data pipelines to ingest and enable analytics at scale.Develop and maintain...

  • Senior Data Engineer

    4 days ago

    Vancouver, British Columbia, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our Promotions team at Amazon. As a key member of our team, you will be responsible for designing, processing, and managing large datasets across various data platforms.Key ResponsibilitiesDesign and implement data pipelines to ingest and enable analytics at scale.Develop and maintain...

  • Amazon Senior Big Data Engineer, 7814

    2 weeks ago

    Vancouver, Canada Data Engineer Jobs Full time

    Senior Big Data Engineer, 7814 - Selling Partner PromotionsDESCRIPTION Are you interested in applying your background in data engineering to impact the lives of millions of Amazon customers? Do you like to own end-to-end business problems, and directly impact the profitability of the company? Do you like to innovate, and simplify? If yes, then you may be a...

  • Amazon Senior Big Data Engineer, 7814

    2 weeks ago

    Vancouver, Canada Data Engineer Jobs Full time

    Senior Big Data Engineer, 7814 - Selling Partner PromotionsDESCRIPTION Are you interested in applying your background in data engineering to impact the lives of millions of Amazon customers? Do you like to own end-to-end business problems, and directly impact the profitability of the company? Do you like to innovate, and simplify? If yes, then you may be a...

  • Data Engineering Leader

    5 days ago

    Vancouver, British Columbia, Canada Amazon Data Services Canada, Inc. Full time

    About the RoleWe are seeking a highly skilled Data Engineering Leader to join our team at Amazon Data Services Canada, Inc. As a key member of our organization, you will be responsible for leading and mentoring a team of engineers to design, develop, and deploy data systems that support our business operations.Key ResponsibilitiesLead a team of engineers to...

  • Data Engineering Leader

    3 days ago

    Vancouver, British Columbia, Canada Amazon Data Services Canada, Inc. Full time

    About the RoleWe are seeking a highly skilled Data Engineering Leader to join our team at Amazon Data Services Canada, Inc. As a key member of our organization, you will be responsible for leading and mentoring a team of engineers to design, develop, and deploy data systems that support our business operations.Key ResponsibilitiesLead a team of engineers to...

  • Staff Software Engineer

    2 months ago

    Vancouver, Canada Data Spree GmbH Full time

    Marqeta is actively seeking a Staff Software Engineer for their Big Data Platform as a Service team, focusing on building a large-scale data platform to enable cross-product solutions. The role entails leveraging software engineering skills primarily in Java and utilizing cloud-native environments to create distributed data processing systems. Candidates are...

  • Staff Software Engineer

    2 months ago

    Vancouver, Canada Data Spree GmbH Full time

    Marqeta is actively seeking a Staff Software Engineer for their Big Data Platform as a Service team, focusing on building a large-scale data platform to enable cross-product solutions. The role entails leveraging software engineering skills primarily in Java and utilizing cloud-native environments to create distributed data processing systems. Candidates are...

  • SafetyCLI: Senior Data Engineer

    3 months ago

    Vancouver, Canada DATA MART Consulting GmbH Full time

    We are on the lookout for a talented Senior Data Engineer to contribute significantly to our advanced data collection, processing, and analysis system which is based on a Python/Django/Postgres stack. Responsibilities: – Work in tandem with the Lead System Architect to develop robust data ingestion, processing, and vulnerability review components, with...

  • SafetyCLI: Senior Data Engineer

    3 months ago

    Vancouver, Canada DATA MART Consulting GmbH Full time

    We are on the lookout for a talented Senior Data Engineer to contribute significantly to our advanced data collection, processing, and analysis system which is based on a Python/Django/Postgres stack. Responsibilities: – Work in tandem with the Lead System Architect to develop robust data ingestion, processing, and vulnerability review components, with...

  • Data Engineering Leader

    2 weeks ago

    Vancouver, British Columbia, Canada Amazon Data Services Canada, Inc. Full time

    About Amazon Data Services Canada, Inc. At Amazon Data Services Canada, Inc., we are dedicated to building innovative data solutions that power our global operations and drive customer success. Our team is passionate about leveraging the latest technologies to create impactful and scalable systems. About the Role: We are seeking a talented and experienced...

  • SafetyCLI: Senior Data Engineer

    1 month ago

    Vancouver, Metro Vancouver Regional District, CA DATA MART Consulting GmbH Full time

    We are on the lookout for a talented Senior Data Engineer to contribute significantly to our advanced data collection, processing, and analysis system which is based on a Python/Django/Postgres stack. Responsibilities: – Work in tandem with the Lead System Architect to develop robust data ingestion, processing, and vulnerability review components, with...

  • Data Engineer III

    2 months ago

    Vancouver, Canada Amazon Data Services Canada, Inc. Full time

    In 2019, Amazon co-founded The Climate Pledge and made a commitment to achieve net-zero carbon by 2040—10 years ahead of the Paris Agreement. We invited others to join us and there are now more than 300 businesses and organizations across 51 industries and 29 countries that have signed the Pledge, which means we are collectively coming at the climate...

  • Senior SQL Data Analyst

    4 weeks ago

    Vancouver, Canada NTT Data Full time

    Req ID: 293568 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior SQL Data Analyst - REMOTE to join our team in Vancouver, British Columbia (CA-BC), Canada (CA). Day to...

  • Data Engineer

    2 months ago

    Vancouver, Canada Electronic Arts Full time

    At our core, Electronic Arts is a game maker that connects hundreds of millions of players from around the globe to some of the world's greatest games. The EAX team is driving the strategy and implementation of essential projects for EA's community of players to connect them to the games they love to play. These projects span the digital touchpoints where...

  • Data Engineer

    1 month ago

    Vancouver, Canada Electronic Arts Inc. Full time

    At our core, Electronic Arts is a game maker that connects hundreds of millions of players from around the globe to some of the world's greatest games. The EAX team is driving the strategy and implementation of essential projects for EA's community of players to connect them to the games they love to play. These projects span the digital touchpoints where...

  • Data Engineer

    2 months ago

    Vancouver, Canada Electronic Arts Full time

    At our core, Electronic Arts is a game maker that connects hundreds of millions of players from around the globe to some of the world's greatest games. The EAX team is driving the strategy and implementation of essential projects for EA's community of players to connect them to the games they love to play. These projects span the digital touchpoints where...

  • Data Engineer

    1 month ago

    Vancouver, Canada Electronic Arts Inc. Full time

    At our core, Electronic Arts is a game maker that connects hundreds of millions of players from around the globe to some of the world's greatest games. The EAX team is driving the strategy and implementation of essential projects for EA's community of players to connect them to the games they love to play. These projects span the digital touchpoints where...

  • Data Engineer

    3 days ago

    Vancouver, British Columbia, Canada Sanctuary AI Full time

    About the RoleWe are seeking a highly skilled DataOps Engineer to join our Data Collection team at Sanctuary AI. As a DataOps Engineer, you will play a critical role in designing, implementing, and maintaining our data collection platform.Key ResponsibilitiesParticipate in data collection sessions to ensure smooth execution and high-quality dataAcquire and...

  • Data Engineer

    5 days ago

    Vancouver, British Columbia, Canada Sanctuary AI Full time

    About the RoleWe are seeking a highly skilled DataOps Engineer to join our Data Collection team at Sanctuary AI. As a DataOps Engineer, you will play a critical role in designing, implementing, and maintaining our data collection platform.Key ResponsibilitiesParticipate in data collection sessions to ensure smooth execution and high-quality dataAcquire and...