Current jobs related to BIG DATA Application Developer - Canada - Macropus Global

  • Big Data Developer

    4 hours ago

    Canada beBee Careers Full time

    Technical ExpertiseWe are seeking a Big Data Developer with expertise in designing and building distributed, scalable, and fault-tolerant software systems. The ideal candidate will have experience with big data processing technologies, including Hadoop ecosystem, Map/Reduce, and stream processing.Main Responsibilities:Design and implement data processing...

  • Big Data Development Expert

    7 days ago

    Canada Luxoft Full time

    **About the Role**We are seeking a skilled Big Data Developer to join our team at Luxoft.As a Big Data Developer, you will be responsible for building new components that integrate with existing infrastructure. You will also build components for data analysis and tooling, liaise with internal development teams, and deliver on time regulatory...

  • Big Data Analytics Developer

    3 days ago

    Canada beBee Careers Full time

    Big Data Analytics DeveloperWe are looking for an experienced Big Data Analytics Developer to join our team.About the Role:Design, develop, and deploy data analytics solutions using Big Data technologies.Collaborate with data scientists and engineers to integrate data from various sources.Build data warehouses, data lakes, and other data storage...

  • Sr. Big Data Spark Developer

    3 weeks ago

    canada | ca Iris Software Inc. Full time

    Our Client which is a large Investment Bank is urgently looking to hire a Sr. Big Data Spark Developer. Location - Mississauga, ON. Initially Remote. Later Onsite. Full job descriptionSpark Scala developer position with key skills in Spark, Kafka, big data platform toolsDesign and development of data ingestion pipelines.Perform data migration and conversion...

  • Senior Big Data Developer

    12 hours ago

    Canada beBee Careers Full time

    Job Overview:We are looking for a highly skilled Senior Big Data Developer to join our team. The successful candidate will be responsible for designing, implementing, and maintaining large-scale data processing systems using Databricks and other big data technologies. The ideal candidate will have a deep understanding of distributed computing principles,...

  • Big Data Developer

    4 weeks ago

    Canada Luxoft Full time

    Project Description: During the 2008 financial crisis, many big banks failed or faced issues due to liquidity issues. Lack of liquidity can kill any financial institution over the night. That's why it's so critical to constantly monitor liquidity risks and properly maintain collaterals. We are looking for a number of talented developers, who would like to...

  • Big Data Developer

    4 weeks ago

    Canada Luxoft Full time

    Project Description:During the 2008 financial crisis, many big banks failed or faced issues due to liquidity issues. Lack of liquidity can kill any financial institution over the night. That's why it's so critical to constantly monitor liquidity risks and properly maintain collaterals.We are looking for a number of talented developers, who would like to join...

  • Big Data Solutions Architect

    3 days ago

    Canada beBee Careers Full time

    Big Data Solutions ArchitectWe are seeking a seasoned expert in Big Data Architecture for a full-time position.About the Role:Train individuals and corporate customers on Big Data applications, basic setup, and administration.Hands-on development role focused on creating Big Data and analytics solutions.Commit to or contribute via code or technical guidance...

  • Big Data Consultant

    3 weeks ago

    Canada Soho Square Solutions Full time

    Hi, This side Nidhi from Soho Square solution ,please share your resume if interested and available for the opportunity Position Title : Big Data Cloud Expert Montreal, QC 3 days/week. Contract Hybrid ABOUT THE JOB: As Big Data Cloud Expert, you are part of a global central team distributed between Montréal and Paris, with multiple responsibilities...

  • Big Data

    3 weeks ago

    Canada KTek Resourcing Full time

    Good Big Data resource with the below Skillset: § Spark § Scala § Hive/HDFS/HQL • Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.)• Experience in Big data technologies , real time data processing platform(Spark Streaming) experience would be an advantage. • Consistently demonstrates clear and concise written and verbal communication...

BIG DATA Application Developer

3 weeks ago

Canada Macropus Global Full time

BIG DATA Application Developer & Product Trainer

Macropus Global Ltd, Victoria, BC, and Dartmouth, NS Canada. https://www.macropusglobal.com | https://www.macropuseducation.com

Macropus Global Ltd (www.macropusglobal.com ) was founded in January 2009 with a vision of providing best services in the field of Information Technology Consulting Business Services. In early 2016 Macropus Global has expanded to IT educational (www.macropuseducation.com ) services for IT Training for Corporates & Individuals across the globe and placing Canadian individuals to the main stream Canadian workforce. Macropus Global has further expanded its wings into Canada Immigration & Visa Services.

We have an immediate need/opening of an expert in Big Data Application Developer for a fulltime in British Columbia and Nova Scotia . Experience in administration in multiple domains will be an added advantage. Join our team in a position that lets you grow with us

Job Summary :

Train individuals and corporate customers on Big Data applications, basic set up and administration. Hands on development role focused on creating big data and analytics solutions. Commits or contribution via code or technical guidance to Apache Hadoop, Spark or related big data projects . Development and management of bringing in various data sources into a global Data Lake. Analyze business and functional requirements and contribute to overall solution. Participate in design reviews, provide input to the design recommendations. Participate in project planning sessions with project managers, business analysts and team members. Translate complex functional and technical requirements. Load disparate data sets using SQL, Apache Spark framework, Scala language, and Cloudera Hadoop. Perform complex analysis, design, development, testing, and debugging of computer software. Perform activities related to software design, operating architecture integration, and support in the selection of appropriate tools and technologies. Create technical specifications, unit test plans, dataflow diagrams and logical data models. Experience of handling data in various file types; flatfiles, XML, Parquet, data frames etc. Experience with Git and MAVEN. Follow quality assurance guidelines including the documentation, review and approval of all project related artifacts. Architect, implement, and test data processing pipelines and data mining / data science algorithms on a variety of hosted settings such as AWS, Azure, client technology stacks. Research, experiment, and utilize leading Big Data methodologies, such as Hadoop, Spark, Redshift, Netezza, SAP HANA, and Microsoft Azure. Design and develop data structures and ETL Processes using, HIVE, HBase, PIG Scripts, Java functions, Spark with Scala. Designing, building, installing, configuring, and supporting Hadoop. Good exposure to columnar NoSQL DBs like HBase. Candidate must have a deep understanding of logical and physical data modeling for OLTP and OLAP systems. Ability to translate a logical data model into a relational or non-relational solution as appropriate. Monitor and analyze job performance, file system/disk space management, cluster & database connectivity and log files. Data Ingestion using Kafka, Storm, Spark or Complex Event Processing (CEP). Machine Learning integration within Spark using SparkML and SparkMLLib. Hadoop integration points with enterprise BI and EDW tools. Perform performance tuning, YARN and big data administration. Data querying with hive, pig and impala.

Only candidates with above qualifications should apply

Key Skills Required:

S./M.S in Computer Science, Mathematics, Engineering, or equivalent work experience required. Big Data Hadoop and Spark Developer certification is a Big Plus. Strong problem solving skill set, and the ability to understand new technologies quickly are essential. Understanding of basic SQL commands necessary to perform administrative functions. Strong experience with ELT, specifically around data wrangling and transformation. Experience with software engineering in all aspects of the SDLC. Experience with Apache Spark framework and Scala language. Experience with Hadoop, Data transport, Spark, Hive, HDFS. Familiarity with web, ftp, api, sql and related ETL technologies. Knowledge of noSQL Databases like Cassandra and RDBMS like MySQL. Experience with Java or J2EE/Scala/Python. Experience with KAFKA is a plus. Experience with SCRUM agile methodology process and development practices. Experience in Unix/Linux shell scripting or similar programming/scripting knowledge. Experience with developing and managing Web services, including REST or SOAP. Experience with AWS is a plus. Knowledge towards Machine learning algorithms is a big plus.

Qualifications :

Masters in Computer Engineering and/or Computer Science, or equivalent industry experience At least 2 to 4 years Big Data Developer experience with mission critical systems in a medium to large environment. Experience working with internal and external organizations solving complex problems and handling large scale projects. Proven ability to drive systems optimizations on large scale infrastructure.

Assets:

Any Expert level Platform certifications (Both Hadoop and Spark).

We will check references with previous employers. If you are a qualified candidate, please email cover letter, pay requirements, work history, resume, and references. We will contact the most qualified candidates within the next month. Email responses only.

We are an "Equal Opportunity Employer" -- this job description / advertisement does not constitute an offer or guarantee of employment