Type : Full Time
Location : Hyderabad
Experience Required : 12 Year(s)
Industry : BPO/ITES
Preferred Skills : Big Data Hadoop Hbase HDFS Map Reduce NoSQL SQL
Job Description :
-Experience of at least 4 years in architecting Big Data solution at enterprise scale with at least one end to end implementation.
-Experienced on data architecture including data ingestion pipeline design, Hadoop information architecture, data modeling and data mining, machine learning and advanced data processing.
-Experience working in core development Big Data projects, Should be able to perform hands-on development activities particularly in Map Reduce, Spark, HBase, Hive, kafka and Shell Scripts.
-Expertise in any one of the commercial Hadoop distributions (Cloudera / Hortonworks/ MapR).
-Strong understanding & experience of Hadoop eco system such as HDFS, MapReduce, Yarn, Spark, Scala, Hive, HBase, SQL on Hadoop and Sqoop.
-Strong understanding & experience in Relational Database, Dimensional Database and SQL.
-Troubleshoot and develop on Hadoop technologies including HDFS, Hive, Spark, Scala, Map Reduce and ETL development.
-Ability to articulate pros & cons of design/architecture decisions across a wide spectrum of factors.
-Ability to scale and tune existing and new architecture.
-Responsible for designing, developing, testing, tuning and building a large-scale data processing system
-Must have knowledge on Hadoop security components like Kerberos, SSL, and Encryption using TDE etc.
-Excellent oral and written communications skills
-Should be able to document use cases, solutions and recommendations
-Must have good knowledge on third party tools supporting big data
-Must possess good knowledge on NoSQL database systems
-Must have good experience in Python
-Must have worked on CICD environment (Git, Maven)
-Hadoop Certified Developer/Architect will have added advantage.
-Should have worked in agile environments.