Implementation and configuration / new developments of Enterprise Big Data solutions as per Business Requirement while leading the smooth operationalization of platform. Also, to be able to architect the most optimized/suited big data solution for the business.
The Job
- Installation, configuration, and upgrading of Big Data solutions while leading the team for smooth operationalization
- Benchmark systems, analyze system bottlenecks, and propose solutions to eliminate them
- Provide deep subject matter expertise, advice for the program delivery while establishing architectural principles and patterns
- Conduct technical and design reviews while understanding system integration concepts and patterns
- Review the business requirements captured and assess gaps
- Innovation role on Digital Data with latest technologies and identify customer expectations and competitor movements fast and accurate and same time coordination among organizational units to enhance operational backbone
- Carrying out R&Ds to select best suited Big Data technologies
- Design ETL flow using technologies such as Sqoop / Flume / Kafka / Hive / Oozie / PIG / AWS Glue / Airflow
- Responsible for performing monthly / quarterly performance analysis to identify the application bottlenecks, issues and new resources requirements while defining the process and continuous improvement
- Troubleshooting on system issues, attending to faults, analysis of issues, applying corrective action / workarounds, proving RCAs
- Periodically update relevant patches on Big Data platforms while assessment of the Big Data platform to identify gaps for patch and make long-term and short-term plans to bridge the gaps
- Perform Unix / Linux administrative tasks while planning and execution of performance improvement activities essential to Maintain smooth operational environment
- Implementing and managing OS level security and patch upgrades while maintaining minimum baseline security of servers (Periodic VA Scans / Recommending patches)
- Maintaining up to date documentation, connectivity diagrams, and related information for all the application liaised within the responsibility of this position
- Career path development and create Learning opportunities for subordinates