Data Engineer
7 months ago
Data Engineer
On behalf of our client, Procom Consultants Group is currently looking for an Intermediate Data Engineer.
Requested resources to provide developer expertise on coding of data transformation pipelines and systems integration tasks relating to enterprise data management applications that span across different business areas and platforms.
Data Engineer Job Details
• Creating mapping documentation of data elements from source to target and liaising with other Data Engineers, Data Architects and SMEs.
• Developing & testing Data Transformation pipelines by leveraging the latest Big Data tools and technologies
• Collaborate with upstream data teams, develop data validation and test plans, performing user acceptance testing, and provide feedback to development and sustainment teams
• Conducting analysis for moderate to complex data requests, defining data fields and determining data availability, developing information layout, format and interactivity. Presenting findings and providing clarification.
• Act as a lead developer to implement code changes in various environments and platforms leveraging our DevOps & DataOps
• Work closely with the testing team to assist with issues raised in user acceptance testing (UAT) and Business Value Testing (BVT)
Deliverables:
Fully implement the new data format across all IM supported platforms including
Big Data (Hadoop), Enterprise Data Warehouse (EDW) and Operational Data Store
(ODS)
Data Engineer Mandatory Skills
Communication & Problem Solving Skills:
• Communicating & presenting solutions to internal developers
• Ability to apply critical thinking skills to develop efficient code, data transformation logic and solution design
• Experience and/or understanding of Agile Methodologies
Technical Skills:
• Advanced Database Skills & SQL
• Experience with or exposure to Big Data platforms, ideally exposure to Hadoop ecosystem (HDFS, Apache Hive, Apache Spark, SparkSQL)
• Extensive programming experience in either Java, C++ or preferably Scala, IntelliJ, Jenkins
• Working experience with Apache Spark Data Processing Framework, Parquet data format
• Good understanding of Relational (Oracle/DB2) and Hadoop Big Data platforms
• Experience working with Jira
Data Engineer Start Date
Oct 24, 2022
Data Engineer Assignment Duration
March 31 2023
Data Engineer Working Location
Fully remote but PST hours
-
Director, Data Management
4 weeks ago
Vancouver, Canada Treasure Data Full timep>Treasure Data: At Treasure Data, we’re on a mission to radically simplify how companies use data to create connected customer experiences. Our sophisticated cloud-based customer data platform drives operational efficiency across the enterprise to deliver powerful business outcomes in a way that’s safe, flexible, and secure.We are thrilled that Gartner...
-
Data Engineering Director
4 weeks ago
Vancouver, British Columbia, Canada Treasure Data Full timeAt Treasure Data, we're dedicated to making data-driven decision-making a reality. As a key member of our team, you'll play a vital role in driving the success of our Real-Time product.About UsWe're a leader in Customer Data Platforms, as recognized by Gartner Magic Quadrant for 2024. Our cloud-based customer data platform simplifies how companies use data...
-
Chief Data Architect
2 weeks ago
Vancouver, British Columbia, Canada Treasure Data Full timeJob Summary:We are seeking a seasoned Director of Data Management to lead our Engineering team in driving technical strategy and architectural decisions. As a key member of our CTO Office, you will oversee project delivery, ensure customer-centric solutions, and maintain operational excellence.Key Responsibilities:Contribute to product strategy by defining...
-
Data Engineer
7 months ago
North Vancouver, Canada CB Canada Full timeData Engineer - Big Data Platform On behalf of our client, Procom Consultants Group is currently searching for a Data Engineer - Big Data Platform.The Senior Data Engineer will join the Information Management team and focus on the development of big data reporting and analytics solutions, working closely with business partners and stakeholders to meet their...
-
Data Engineer III
6 months ago
Vancouver, Canada Amazon Data Services Canada, Inc. Full timeIn 2019, Amazon co-founded The Climate Pledge and made a commitment to achieve net-zero carbon by 2040—10 years ahead of the Paris Agreement. We invited others to join us and there are now more than 300 businesses and organizations across 51 industries and 29 countries that have signed the Pledge, which means we are collectively coming at the climate...
-
Data Engineer
7 months ago
North Vancouver, Canada CB Canada Full timeData Engineer (Python or Scala)On behalf of our client, Procom Consultants Group is currently looking for a Data Engineer (Python or Scala). This contract Data Engineer will be responsible for automating the fetching of claims documents from OpenText Content Server and using an open source tool tesseract to extract text from the documents. The extracted...
-
Data Engineer
1 month ago
Vancouver, Canada Randstad Canada Full timeAre you an experienced Data Engineer in search of your next contract opportunity? Our high-profile client is seeking to hire a Lead Data engineer to join their talented team on a 6-month contract with a strong probability of extension. Apply for this amazing opportunity if this sounds like a good fit for you!AdvantagesWhat’s in it for you!As a consultant...
-
Data Engineer
1 month ago
Vancouver, Canada Beatdapp Full timeBeatdapp is a venture-backed startup delivering the most advanced music tracking and fraud detection technology in the world. Ranked #2 startup in Canada and Top 20 Music Companies globally, our industry-leading software helps artists and labels track and audit their media streams for royalty payments. Our fraud detection tools help streaming services...
-
Data Engineering Leader
1 month ago
Vancouver, British Columbia, Canada Activision Full timeJob Title: Data Engineering LeaderDemonware, a member of the Activision family of studios, seeks a highly skilled Data Engineering Leader to join its talented data engineering team.
-
Data Engineer
6 days ago
Vancouver, Canada Amazon Web Services (AWS) Full timeDescriptionThe AWS Kumo team provides technology and trusted expertise that intelligently anticipate and resolve AWS customer needs, helping them adopt, optimize, and operate at scale. Kumo’s products, used by AWS customers and the Support teams that help them, are vital to ensuring exceptional customer experiences on AWS. Our team owns customer facing...
-
Data Engineer
3 weeks ago
Vancouver, British Columbia, British Columbia, Canada Alquemy Search & Consulting Full timeData Engineer12 month contract opportunity, high potential to extend"Hybrid" work environment - 2 times per week in downtown Vancouver officeSeeking a Data Engineer who is passionate about big data technology and delivering data solution to handle TB scale data per day and help the business meet the distinct needs of customers. Role & responsibilities: Data...
-
Data Engineer Lead
4 weeks ago
Vancouver, Canada Product And Technology Full timeAbout the RoleWe are seeking a skilled Data Engineer Lead to join our Product and Technology team in Vancouver, BC. As a key member of our data engineering team, you will be responsible for implementing data storage and processing solutions for business analytics.
-
Data Engineer
2 months ago
Vancouver, Canada Vancity Full timeA typical day would involve: Design and build efficient & reliable data pipelines, cleanse, and normalize diverse datasets for Analytics. Troubleshoot and resolve problems of data services that support business & applications systems and provide solutions to pro-actively prevent problems from happening. Create and manage knowledgebase, access...
-
Data Engineer
1 month ago
Vancouver, Canada Yeah! Global Full timeNote: This position does not offer any Visa sponsorship. We are only looking for applicants who are either local to Vancouver, Canada, or ready to relocate to the employer's location. Job Summary: Our Client is looking for a skilled Data Engineer to join their team. The ideal candidate will be responsible for designing, implementing, and maintaining data...
-
Data Engineer
1 day ago
Vancouver, British Columbia, Canada Amazon Full timeAt Amazon, we're revolutionizing the way people live and work through innovative technology. Our Promotions organization is at the forefront of this revolution, owning the entire promotions lifecycle running on Amazon marketplace.We're seeking a highly skilled Data Engineer to join our team. As a key member of our organization, you'll be responsible for...
-
Data Engineer, Data Platform Trust and Safety
5 months ago
Vancouver, Canada TikTok Full timeTeam Introduction The Data Platform team works on building data infrastructures and data products to support business engineering teams at TikTok. As a data engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on...
-
Senior Data Engineer
1 month ago
Vancouver, Canada Beatdapp Full timeBeatdapp is a venture-backed startup delivering the most advanced music tracking and fraud detection technology in the world. Ranked #2 startup in Canada and Top 20 Music Companies globally, our industry-leading software helps artists and labels track and audit their media streams for royalty payments. Our fraud detection tools help streaming services...
-
Data Engineer Lead
3 weeks ago
Vancouver, Canada Intelliswift Software Full timeJob OverviewWe are seeking a skilled Data Engineer Lead to join our team at Intelliswift Software.SalaryThe estimated salary for this position is $120,000 - $150,000 per annum, depending on experience.About the RoleAs a Data Engineer Lead, you will be responsible for providing production support for data pipelines and applications using Python, ADF, Azure...
-
Data Engineer for AI and Data Science
2 weeks ago
Vancouver, British Columbia, Canada Microsoft Canada Full timeCompany OverviewMicrosoft Canada is a leader in cloud technology, empowering innovators to transform the world. With a passion for collaboration, Microsoft envisions new possibilities and fosters career growth.Salary$124,000 - $170,000 per annum, depending on experienceJob DescriptionData engineers and data scientists join forces to extract intelligence from...
-
Distributed Systems Data Engineer
1 month ago
Vancouver, British Columbia, Canada Activision Full timeJob Title: Distributed Systems Data EngineerAbout Us:Demonware, a leading developer of AAA games, seeks a highly skilled Data Engineer to join its team. As part of the Activision family of studios, we leverage cutting-edge technologies to deliver seamless online experiences.Your Mission:As a key member of our data engineering team, you will design and...