Wanted Spark/Hadoop Engineer : Required for a Bank 

Post an ad like this for FREE!
  • Date Listed21/11/2020
  • Job TypeFull-Time

Key Skill : Spark/Hadoop working experience with very good knowledge.

Job Purpose :

The position exists to continuously enhance the efficiency of existing Data pipeline Job/framework and setup a best practice for Big Data projects planned on the BI & Analytics platform.



Key Accountability :


1. Review and tune the code for the Spark framework to increase the throughput.

2. Establish best practices and guidelines to be followed by tech teams while writing codes in Spark.

3. Create a framework to continuously monitor the performance and identify the resource intensive jobs.


Job Duties & responsibilities :

· Able to write code, services and components in Java, Apache Spark and Hadoop.

· Responsible for systems analysis Design, Coding, Unit testing, CICD and other SDLC activities.

· Proven experience working with Apache Spark streaming and batch framework.

· Proven experience in performance tuning Java, Spark based applications is a must.

· Knowledge of working with different file formats like Parquet , JSON and AVRO.

· Data Warehouse experience working with RDBMS and Hadoo, Well versed with concepts of change data capture and SCD implementation.

· Hands-on experience in writing codes to efficiently handle files on Hadoop.

· Ability to work in projects following Micro Services based architecture.

· Knowledge of S3 will be a plus.

· Ability to work proactively, independently and with global teams.

· Strong communication skills should be able to communicate effectively with the stakeholders and present the outcome of analysis.

· Working experience in projects following Agile methodology is preferred.


Required Experience :

- At least 3 to 9 years of working experience, preferably in banking environments

- Expert knowledge of technologies e.g. Hadoop, Hive, Presto, Spark, Java, RDBMS like Teradata and File storage like S3 are necessary.

- Candidate must speak and write well.

- Degree Holder.


Core Competencies :

· Experienced on Hadoop frameworks such as Hive, Spark, Java.

· Strong knowledge of relational database systems and data warehousing techniques.

· Strong listening and communication skill set, with ability to clearly and concisely explain complex technical issues.

Only Singaporeans or PR can apply


Experience : 3 to 9 years


Contract:1 year


Contact: sales@rapidsystemz.com

Attach a file(maximum 2MB)
Uploading
[Remove]
By clicking "Send" you accept the Terms of Use and Privacy Notice and agree to receive newsletters and promo offers from us.
Add to Watchlist
 Safety Tips - Your safety is important to us and we believe that you can stay safe. Learn MoreReport this ad
Ang Mo Kio / Bishan / Thomson
You might be interested in these similar ads
Senior Electrical Engineer [$4k-$6k / AMK / Site]
Responsibilities· Lead the Project Team as a Project Manager to monitor and manage the project progression and work within the costing.· To monitor and supervise sub contractors’ work progression according to shop drawings, method statements, material and samples· To liaise and work with relevant authorities, sub-contractors or clients on shop drawings, materials and samples· Review and align Elec ...
Senior Electrical Engineer [Ang Mo Kio / M&E / E&E]
Senior Engineer (Electrical) (2 years contract position renewable / convertible)$4,000 to $6,0005.5 days Monday - Friday 8.30am to 6pm ; Saturday 8.30am- 12.30pmAng Mo Kio Job ResponsibilitiesLead the Project Team as a Project Manager to monitor and manage the project progression and work within the costing.To monitor and supervise sub contractors’ work progression according to shop drawings, meth ...
Looking for Workshop Estimator
URGENT (Immediate Vacancy)Looking for Assistant Workshop Manager (Estimator experience) in Motor Workshop / Car RentalWorking Location: Sin MingWorking Hours: 6 days work week (SUN OFF)Mon - Fri: 8.45am - 5.45pmSat: 8.45am - 6pmSUN OFFSalary: Starting from $2500 (Depends on working exp)Job Responsibilities:- Assisting with testing and diagnosing of car issues- Writing estimates of repair costs to ...
QA Manager (Electronic Manufacturing / S$5000 / North)
* Office hour, Monday - Friday* Location: North* Basic up to 5K! + AWS + VB* Permanent roleOur client is a microelectronic industry leader in design, development, manufacture, sale and support of advanced semiconductor wafer probe cards.Job Description:1. Manage QA sectionLead inspection teams (IQA & OQA), QA Supervisor and EngineersTake charge of all related QA equipment and inventori ...
Car Mechanic (Sin Ming Autocare)
Responsibilities •Performing test drives, inspections, and other diagnostic tests on vehicles to identify where problems exist and determine which parts need to be repaired or replaced. •Clear communication with operation admin to monitor inventory and order new parts when necessary. •Conduct regular maintenance on machinery, system, and automotive vehicles. •Completing preventati ...
Technician [Telecommunication/ PBX System/ up to $2500/ 5.5 alt Sat/ AMK]
Singaporeans only.If you are interested to apply, kindly WhatsApp or Email me your updated resume in DOC file and allow our Consultant to match you with our Clients.Whatsapp: +65 82777215 (Jeslyn)Email: supreme.jeslynquah@gmail.comReg No: R1982418EA No: 14C7279
★ Contract Technicians X 50 @ Serangoon / AMK ★ $1700 - $1950 + allowance★ in Ang Mo Kio / Bishan / Thomson, preview image
★ Contract Technicians X 50 @ Serangoon / AMK ★ $1700 - $1950 + allowance★
WE ARE HIRING: Contract Technicians X 50 @ Serangoon / AMKJOIN OUR TELEGRAM CHANNEL FOR MORE UPDATED TEMP JOBS♣ https://t.me/sgtempjobs ♣We are hiring under Recruit Express headcount and you will be deployed to:Job Description:Assembly duties Testing and trouble shooting Configuration duties Dealing with phone production machinery Housekeeping duties To support other processes/activi ...
More ads