Lead Data Engineer
3 weeks ago
Netskrt Systems Inc. is a leading-edge CDN company dedicated to pushing the boundaries of innovation. We are seeking a talented and motivated Senior Software Engineer to build a world-class, large-scale analytics platform for the large amounts of data we collect and investigate how we can use AI/ML to optimize our production environments based on that data.
Key Responsibilities- Data Pipeline Development: Design, develop, and maintain data pipelines and ETL processes that ingest, transform, and store data from various sources, using technologies such as Spark, Hadoop, ClickHouse, and Cassandra.
- Machine Learning Implementation: Implement and optimize machine learning models and algorithms to solve various business problems and deliver insights and recommendations.
- API Development: Develop and maintain APIs and web services that expose machine learning functionality and results to internal and external users and applications.
- Data Analysis: Perform data analysis and exploration to understand data quality, distribution, and patterns.
- Collaboration: Work closely with data scientists, software engineers, and product managers to understand business requirements, define data and machine learning solutions, and deliver high-quality results.
- Troubleshooting: Troubleshoot and resolve issues related to the performance and reliability of data pipelines, machine learning models, and applications.
- Industry Trends: Stay abreast of industry trends and emerging technologies, providing recommendations for continuous improvement in data engineering and machine learning practices.
- Education: Bachelor's degree in Computer Science, Data Science, Statistics, or a related field.
- Programming Skills: Strong proficiency in Python development with a deep understanding of Python-based applications.
- Big Data Experience: Extensive experience with big data technologies such as Spark, Hadoop, ClickHouse, and Cassandra.
- Data Engineering: Solid understanding of data engineering, data quality, data governance, and data security best practices.
- Problem-Solving: Strong problem-solving skills and the ability to troubleshoot complex issues in a production environment.
- Attention to Detail: Strong attention to detail and a commitment to delivering high-quality software solutions.
- Communication: Strong communication and collaboration skills, with the ability to effectively convey ideas and data-related concepts to both technical and non-technical stakeholders.
- Caching and CDN Experience: Experience with caching and CDN (content delivery network) technologies (CloudFront, Limelight/Edgio, Akamai, Fastly, Netflix, Google).
- Cloud Platforms: Experience with cloud platforms and services, such as AWS, Azure, or Google Cloud.
- Database Technologies: Database technologies (PostgreSQL, MYSQL, RabbitMQ).
- Network Technologies: Network switching and routing technologies.
- Tiered Storage: Experience with tiered storage solutions.
- Big Data Technologies: Familiarity with big data technologies, such as Hadoop, Spark, YARN, or Elasticsearch.
- Cybersecurity: Knowledge of cybersecurity principles and best practices.
- Casual Dress
- Company Events
- Dental Care
- Disability Insurance
- Discounted or Free Food
- Extended Health Care
- Life Insurance
- On-Site Gym
- Paid Time Off
- Vision Care
- English Not Required
- Monday to Friday
- Are You Legally Authorized to Work in Canada?
- Bachelor's Degree (Required)
- Hybrid Remote in Vancouver, BC
-
Senior Data Engineer
2 weeks ago
Vancouver, British Columbia, Canada Data Engineer Jobs Full timeAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our Promotions team at Amazon. As a key member of our team, you will be responsible for designing, processing, and managing large datasets across various data platforms.Key ResponsibilitiesDesign and implement data pipelines to ingest and enable analytics at scale.Develop and maintain...
-
Senior Data Engineer
2 weeks ago
Vancouver, British Columbia, Canada Data Engineer Jobs Full timeAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our Promotions team at Amazon. As a key member of our team, you will be responsible for designing, processing, and managing large datasets across various data platforms.Key ResponsibilitiesDesign and implement data pipelines to ingest and enable analytics at scale.Develop and maintain...
-
Data Engineering Leader
3 weeks ago
Vancouver, British Columbia, Canada Amazon Data Services Canada, Inc. Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Leader to join our team at Amazon Data Services Canada, Inc. As a key member of our organization, you will be responsible for leading and mentoring a team of engineers to design, develop, and deploy data systems that support our business operations.Key ResponsibilitiesLead a team of engineers to...
-
Data Engineering Leader
2 weeks ago
Vancouver, British Columbia, Canada Amazon Data Services Canada, Inc. Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Leader to join our team at Amazon Data Services Canada, Inc. As a key member of our organization, you will be responsible for leading and mentoring a team of engineers to design, develop, and deploy data systems that support our business operations.Key ResponsibilitiesLead a team of engineers to...
-
Data Engineering Leader
3 days ago
Vancouver, British Columbia, Canada Amazon Data Services Canada, Inc. Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Leader to join our team at Amazon Data Services Canada, Inc. As a key member of our team, you will be responsible for mentoring and leading engineers, guiding them towards best data development practices, and defining the priorities and vision of the group.You will collaborate with users around...
-
Data Engineering Leader
3 days ago
Vancouver, British Columbia, Canada Amazon Data Services Canada, Inc. Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Leader to join our team at Amazon Data Services Canada, Inc. As a key member of our team, you will be responsible for mentoring and leading engineers, guiding them towards best data development practices, and defining the priorities and vision of the group.You will collaborate with users around...
-
Data Engineering Leader
4 days ago
Vancouver, British Columbia, Canada Amazon Data Services Canada, Inc. Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Leader to join our team at Amazon Data Services Canada, Inc. As a key member of our team, you will be responsible for mentoring and leading engineers, guiding them towards best data development practices, and defining the priorities and vision of the group.You will collaborate with users around...
-
Data Engineering Leader
4 days ago
Vancouver, British Columbia, Canada Amazon Data Services Canada, Inc. Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Leader to join our team at Amazon Data Services Canada, Inc. As a key member of our team, you will be responsible for mentoring and leading engineers, guiding them towards best data development practices, and defining the priorities and vision of the group.You will collaborate with users around...
-
Data Engineering Leader
14 hours ago
Vancouver, British Columbia, Canada Amazon Data Services Canada, Inc. Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Leader to join our team at Amazon Data Services Canada, Inc. As a key member of our team, you will be responsible for mentoring and leading engineers, guiding them towards best data development practices, and defining the priorities and vision of the group.You will collaborate with users around...
-
Data Engineering Leader
11 hours ago
Vancouver, British Columbia, Canada Amazon Data Services Canada, Inc. Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Leader to join our team at Amazon Data Services Canada, Inc. As a key member of our team, you will be responsible for mentoring and leading engineers, guiding them towards best data development practices, and defining the priorities and vision of the group.You will collaborate with users around...
-
Data Engineering Leader
6 days ago
Vancouver, British Columbia, Canada Amazon Data Services Canada, Inc. Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Leader to join our team at Amazon Data Services Canada, Inc. As a key member of our team, you will be responsible for mentoring and leading engineers, guiding them towards best data development practices, and defining the priorities and vision of the group.Key ResponsibilitiesCollaborate with...
-
Data Engineering Leader
6 days ago
Vancouver, British Columbia, Canada Amazon Data Services Canada, Inc. Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Leader to join our team at Amazon Data Services Canada, Inc. As a key member of our team, you will be responsible for mentoring and leading engineers, guiding them towards best data development practices, and defining the priorities and vision of the group.Key ResponsibilitiesCollaborate with...
-
Data Engineering Leader
1 week ago
Vancouver, British Columbia, Canada Amazon Data Services Canada, Inc. Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Leader to join our team at Amazon Data Services Canada, Inc. As a key member of our team, you will be responsible for mentoring and leading engineers, guiding them towards best data development practices, and collaborating with users around the globe.Key ResponsibilitiesWork with our Product and...
-
Data Engineering Leader
1 week ago
Vancouver, British Columbia, Canada Amazon Data Services Canada, Inc. Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Leader to join our team at Amazon Data Services Canada, Inc. As a key member of our team, you will be responsible for mentoring and leading engineers, guiding them towards best data development practices, and collaborating with users around the globe.Key ResponsibilitiesWork with our Product and...
-
Data Engineering Leader
4 weeks ago
Vancouver, British Columbia, Canada Amazon Data Services Canada, Inc. Full timeAbout Amazon Data Services Canada, Inc. At Amazon Data Services Canada, Inc., we are dedicated to building innovative data solutions that power our global operations and drive customer success. Our team is passionate about leveraging the latest technologies to create impactful and scalable systems. About the Role: We are seeking a talented and experienced...
-
Lead Data Engineer
2 weeks ago
Vancouver, British Columbia, Canada Narvar Full timeAbout the RoleWe are seeking a highly skilled and experienced Senior Software Engineer to join our Data Engineering team at Narvar.Key Responsibilities:Lead the design and development of data pipelines and systems that can efficiently store, process, and analyze large and complex datasets.Collaborate with data scientists and other teams to integrate data...
-
Lead Data Engineer
3 weeks ago
Vancouver, British Columbia, Canada Narvar Full timeAbout the RoleWe are seeking a highly skilled and experienced Senior Software Engineer to join our Data Engineering team at Narvar.Key Responsibilities:Lead the design and development of data pipelines and systems that can efficiently store, process, and analyze large and complex datasets.Collaborate with data scientists and other teams to integrate data...
-
Data Engineering Lead
5 days ago
Vancouver, British Columbia, Canada Globant Full timeJob Title: Data Engineering LeadWe are seeking a highly skilled Data Engineering Lead to join our team at Globant. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines and data warehouses using Microsoft and Informatica ETL tools.Key Responsibilities:Design and implement...
-
Data Engineering Lead
4 days ago
Vancouver, British Columbia, Canada Globant Full timeJob Title: Data Engineering LeadWe are seeking a highly skilled Data Engineering Lead to join our team at Globant. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines and data warehouses using Microsoft and Informatica ETL tools.Key Responsibilities:Design and implement...
-
Data Engineering Lead
5 days ago
Vancouver, British Columbia, Canada Globant Full timeJob Title: Information Technology LeadJob Summary:Globant is seeking a highly skilled Information Technology Lead to join our team. As a key member of our organization, you will be responsible for leading the development and implementation of data engineering solutions using Microsoft and Informatica ETL tools.Key Responsibilities:Design, develop, and...
