Data Engineer
Description : 26 May, 2023
Job Description:Hybrid Hadoop Engineer and Hadoop Infrastructure Administrator to build and maintain a scalable and resilient Big Data framework to support Data Scientists. As an administrator, your responsibility will be to deploy and maintain Hadoop clusters, add and remove nodes using cluster management and monitoring tools like Cloudera Manager, and support performance and scalability requirements, in support of our Data scientist's needs. Some Relational Database administrator experience will also be desirable to support the general administration of Relational Databases. Design, build, and maintain Big Data workflows/pipelines to process a continuous stream of data with experience in end-to-end design and build process of Near-Real-Time and Batch Data Pipelines. Demonstrated work experience in the following with Big Data and distributed programming models and technologies Knowledge of database structures, theories, principles, and practices (both SQL and NoSQL). Active development of ETL processes using Spark or other highly parallel technologies, and implementing ETL/data pipelines Experience with Data technologies and Big Data tools, like Spark, Kafka, Hive Understanding of Map Reduce and other Data Query and Processing and aggregation models Understanding of challenges of transforming data across distributed clustered environment Experience with techniques for consuming, holding, and aging out continuous data streams Ability to provide quick ingestion tools and corresponding access APIs for continuously changing data schema, working closely with Data Engineers around specific transformation and access needs Preferred: Experience as a Database administrator (DBA) will be responsible for keeping critical tools database up and running Building and managing high-availability environments for databases and HDFS systems Familiarity with transaction recovery techniques and DB Backup Skills and Attributes: Ability to have effective working relationships with all functional units of the organization Excellent written, verbal, and presentation skills Excellent interpersonal skills Ability to work as part of a cross-cultural team Self-starter and Self-motivated Ability to work without lots of supervision Works under pressure and is able to peting priorities. Hide
Job ID: 4059869
___________________
I-cube Software Llc
Related Articles
ESSAGER 100w 7A USB to USB-C data & Charging Cord. Brand New.
2m, 100W, 7.0A charging & data cable. Never opened, brand new in box. Charge phone super fast or transfer files super fast! Selling because I no longe
AIRBAG SYSTEM REPAIR, CRASH DATA RESET
AIRBAG SYSTEM REPAIR, CRASH DATA RESET • WE REPAIR AND RESET AIRBAG MODULES • WE INSTALL CLOCK SPRINGS AND CALIBRATE STEERING ANGLE SENSOR • WE PROGRA
STRUCTURAL ENGINEER - 35 YRS EXPERIENCE
APEGA Engineer Practicing in Alberta and BC for over 35 years - Please check the APEGA website members directory prior to hiring any engineer in the p
Work from Home Data Entry Agent - Canada
Earn money at Home by Participating in Paid Studies - Data Entry agent - Customer Service Rep - Part-time We are seeking people across the country to
Package of 5 calculator rolls + bonus data binder
pack of 5 paper calculator rolls 30223-5 Premium Bond 2 1/4 inches x 125 feet comes with a new data binder as well see pics email if interested thanks
Box of 100 Legal Size Manilla Folders + data binders
new/never used also including a new/sealed data binder $5 for the lot email if interested thanks
Data Dolphin Flow Meter Head
Data logging flow meter head Works with mag and pickup type flow meters Internal lithium battery or AC powered Can generate csv output to SD Field pro
Storage data , sim cards, usb, SD cards
Selling 4 - 128 GB SD CARDS AND 4 USB STORAGE STICKS , AND 2 - 256 GB SIM CARDS. THE 128 GB STORAGE ARE $15 EACH AND THE 2 - 256 GB'S SIM CARDS ARE $4
You may also like
Antique 1940’s 3 Drawer Dresser
Selling my antique 3 drawer dresser 100$ OBO from the 1940's has a few chips and the mirror is foggy can be easily replaced though. 22" high 38" long
Double Hang Closet Rod / Tringle de placard à double suspension
Double Hang Closet Rod / Tringle de placard à double suspension $15 for one / $25 for both
Lumière / socle encastrée extérieur modèle 730
Ampoules non incluses J'ai en 3, elles sont neuves jamais installées Couleur blanche Marque eclairage vision Modèle 730 35$ chaque ou 90$ pour les 3.
Personal Taxes from 30 and Corporate taxes from 175
Personal Taxes from 30 and Corporate taxes from 175 CAD Call or text for quick quote and details. Professional accounting & tax services at your place