Job Title: Scala and Spark Developer

Job ID: 2023-12155

Job Location: Austin, TX; Morris Plains, NJ

Job Travel Location(s):

# Positions: 1

Employment Type: W2

Candidate Constraints:

Duration: Long Term

# of Layers: 0

Work Eligibility: All Work Authorizations are Permitted – No Visa Transfers

Key Technology: Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop

Job Responsibilities:

• Work with business and technical leadership to understand requirements
• Participate in sprint planning sessions and help TPOs
• Troubleshooting the issues, provide effective solutions and application monitoring in productions environment.

Skills and Experience Required:

• 7+ years of strong development experience in Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop
• In depth knowledge on Hadoop architecture and its components
• Strong working knowledge on Single Store (MEMSQL) database
• Should have good hands-on experience working with Indexes, Shard keys, column store, and reference tables using Single Store database.
• Must understand basic AWS services and hands on experience
• Basic to moderate Terraform development experience needed
• Should be able to demonstrate work experience in Hadoop, Spark, hive
• Strong hands-on experience on Scala and Spark is must
• Must have work experience on Hadoop as data warehouse/Data Lake implementations
• Strong experience on DevOps pipeline implementation
• Health care domain knowledge is a plus
• Troubleshooting the Hadoop Yarn jobs is must
• Strong experience in writing complex and effective SQLs, and Stored Procedures
• Strong development experience on Single Store database operations
• Strong profiling skills using Single Store database
• Strong query optimizations skills to improve performance of ETL process
• Implement Hadoop job orchestration using Shell scripting, and Airflow
• Experience in Agile and working knowledge on DevOps tools (Get, Maven, Jenkins, Sonar Cube, and Checkmarks)
• Unix Shell scripting and basic administration of Unix servers
• AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and Cloud Watch)
• Experience in Jira and Confluence
• Must participate in production support model.