Hadoop Developer Job Description

We are seeking a Hadoop developer to assist us in developing large-scale data storage and processing software and infrastructure. Knowledge of current technologies and the ability to create applications utilizing the Hadoop API is required.

Hadoop is a free and open-source platform for managing and storing large data applications in clusters. Hadoop developers are in charge of developing and coding Hadoop applications. A Hadoop developer, in essence, provides programmes to handle and maintain a company's massive data.

• Chief Technology Officer
• Tech Lead
• Lead Hadoop Engineer
• Sr. Software Developer
• JavaScript Developer

• Be in charge of all Hadoop application design, development, architecture, and documentation
• Be in order of installing, configuring, and maintaining Hadoop
• Use a scheduler to manage Hadoop tasks
• Reduce code for Hadoop clusters while also assisting in the creation of new Hadoop clusters
• Translate complex methodology and functional specifications into comprehensive designs
• Create online apps for data querying and fast data tracking, all at better speeds
• Propose the organization's best practises and standards, then transfer them to operations
• Test software prototypes and supervise their subsequent transfer to the operational team
• Use Pig and Hive to pre-process data
• Maintain enterprise data security and Hadoop cluster privacy
• HBase administration and deployment
• AnalyzeAnalyze massive data repositories and obtain insights

• A bachelor's or master's degree in computer science
• Basic understanding of Hadoop and its Eco-System
• Capable of working with Linux and executing most basic commands
• Practical Knowledge of Hadoop Core Components
• MapReduce, Pig, Hive, and HBase are examples of Hadoop technology
• Capability to deal with Multi-Threading and Concurrency in an Eco-System
• Familiarity with ETL and data loading technologies such as Flume and Sqoop
• Ability to deal with Back-End Programming
• A solid understanding of SQL fundamentals and distributed systems
• Extensive programming experience in languages such as Java, Python, JavaScript, and NodeJS
• Familiarity with Java