Data Engineer

2 weeks ago

Nova Scotia NS, Canada ThoughtsWin Full time

Job Description Looking for Senior Data Engineers who are experienced, self-driven, analytical, and strategic. In this role, you will work with clients across large and complex data lake/warehouse environments. You are passionate about working with disparate datasets in order to bring data together to answer business questions. You should have deep expertise in the creation and management of datasets and the proven ability to translate the data into meaningful insights through collaboration with product managers, data engineers, business intelligence developers, operations managers and client leaders. In this role, your skills and expertise will be integral in strategic decision-making, answering complex questions by taking ownership of the end-to-end development of data engineering solutions. Responsibilities Interface with project managers, business customers, data architects and data modelers to understand requirements and implement solutions. Design, develop, and operate highly-scalable, high-performance, low-cost, and accurate data pipelines in distributed data processing platforms providing ad hoc access to large datasets and computing power. Explore and learn the latest big data technologies. Evaluate and make decisions around the use of new or existing software products to design data architectures. Recognize and adopt best practices in data processing, reporting, and analysis: data integrity, test design, analysis, validation, and documentation. Qualifications Bachelor's degree in Computer Science or related technical field, or equivalent work experience. 5+ years of work experience with ETL, Data Modeling, and Data Architecture. 5+ years of experience with SQL and large data sets, data modeling, ETL development, and data warehousing, or similar skills. 2+ years experience with the AWS or MS Azure technology stacks. AWS should include Redshift, RDS, S3, EMR or similar solutions built around Hive/Spark etc. MS Azure should include ADF, Azure BLOB storage, Azure Synapse etc. Excellent in ETL optimization, designing, coding, and tuning big data processes using Apache Spark or similar technologies. Experience operating very large data warehouses or data lakes. Experience with building data pipelines and applications to stream and process datasets at low latencies. Demonstrate efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data. Knowledge of distributed systems and data architecture - design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning, and MPP of high-level data structures. Experience with full software development life cycle, including coding standards, code reviews, source control management, build processes, and testing. Industry Information Technology & Services

  • Senior Ceph Storage Engineer

    1 week ago

    Nova Scotia, Canada GoDaddy Full time $120,000 - $180,000 per year

    R022437Nova Scotia, CanadaIT OperationsRegularLocation Details:At GoDaddy the future of work looks different for each team. Some teams work in the office full-time; others have a hybrid arrangement (they work remotely some days and in the office some days) and some work entirely remotely.Remote: This is a remote position, so you'll be working remotely from...

  • Data Engineer

    2 weeks ago

    Halifax, NS, Canada ThoughtsWin Full time

    Job Description Looking for Senior Data Engineers who are experienced, self-driven, analytical, and strategic. In this role, you will work with clients across large and complex data lake/warehouse environments. You are passionate about working with disparate datasets in order to bring data together to answer business questions. You should have deep expertise...

  • Data Engineer

    1 week ago

    Halifax, NS, Canada ThoughtsWin Full time

    Job Description Looking for Senior Data Engineers who are experienced, self-driven, analytical, and strategic. In this role, you will work with clients across large and complex data lake/warehouse environments. You are passionate about working with disparate datasets in order to bring data together to answer business questions. You should have deep expertise...

  • Pre-Assessment Agent

    3 days ago

    Nova Scotia (NS), Canada HCLTech Full time

    About the RoleAs a Pre-Assessment Agent for Automotive Software Product Support, you will play a critical role in assisting dealerships with diagnostic software and hardware issues related to vehicle modules and systems. You will provide initial responses, troubleshoot issues, and ensure timely resolutions while maintaining compliance with company standards....

  • Senior Pre-Sales Systems Engineer, Atlantic Canada

    1 week ago

    Nova Scotia, Canada Pure Storage Full time $120,000 - $220,000 per year

    We're in an unbelievably exciting area of tech and are fundamentally reshaping the data storage industry. Here, you lead with innovative thinking, grow along with us, and join the smartest team in the industry.This type of work—work that changes the world—is what the tech industry was founded on. So, if you're ready to seize the endless opportunities and...

  • Data Engineer

    3 weeks ago

    New Canada, NS TEEMA Full time

    Data Engineer Must Haves: Minimum of proven experience working as a Data Engineer or similar role. Experience using Informatica software (i.e., Power Centre, Integration Services, Workflow Manager, IDMC and TDM) in an integrated support environment. Expert knowledge of Oracle and SQL Server Database Management Systems and tools. ETL and data pipeline...

  • IT Field Services Technician

    3 days ago

    Nova Scotia (NS), Canada Kelly Professional & Industrial Full time

    Job description:Job SummaryWe are seeking a skilled and motivated Field Service Technician to join our client's dynamic team in New Glasgow, NS. In this role, you will be responsible for installing, maintaining, and repairing equipment at client locations, ensuring optimal performance and customer satisfaction. The ideal candidate has strong technical...

  • Data Engineer

    4 weeks ago

    New Canada, NS TMF Group Full time

    We never ask for payment as part of our selection process, and we always contact candidates via our corporate accounts and platforms. If you are approached for payment, this is likely to be fraudulent. Please check to see whether the role you are interested in is posted on our career website. JOB DESCRIPTION We are looking for a Data Engineer to join our...

  • Data Engineer

    2 weeks ago

    New Canada, NS TMF Group Full time

    We never ask for payment as part of our selection process, and we always contact candidates via our corporate accounts and platforms. If you are approached for payment, this is likely to be fraudulent. Please check to see whether the role you are interested in is posted on our career website. JOB DESCRIPTION We are looking for a Data Engineer to join our...

  • Data Engineer

    2 weeks ago

    South Shore, NS, Canada ANB Sourcing LLC Full time $43,200 - $72,000 per year

    Data EngineerSouth Shore- (Onsite job) (5 days onsite/ week)12+ months contract job.Language: Bilingual - French/EnglishTechnologies or skills required:The Data Scientist applies strong expertise in artificial intelligence through use of machine learning, data mining, and information retrieval to design, prototype and build advanced analytics engines and...