Spark Big Data Lead Consultant

Company: Infosys Limited
Location: Sunnyvale
Posted on: June 1, 2025

Job Description:

Spark Big Data Lead Consultant - USCompany: ITL USARequisition ID: 134000BRInfosys is seeking a Spark Big Data Lead Consultant. In this role, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition, and Design. You will create high-level design artifacts, deliver high-quality code for modules, lead validation for testing, and support activities related to implementation, transition, and warranty. This role fosters a learning culture emphasizing teamwork, collaboration, excellence, diversity, and respect.Location: Candidate must be within commuting distance of Sunnyvale, CA or willing to relocate.Required Qualifications:

• Bachelor's degree or foreign equivalent from an accredited institution; three years of progressive experience may substitute for each year of education.
• Minimum 7 years of experience in Information Technology.
• Authorized to work in the US without employer-sponsored visa; no immigration sponsorship provided.
• Experience with Hadoop frameworks, Spark or PySpark, and Hadoop Ecosystems handling large data volumes.
• Proven experience in data engineering, data architecture, or related fields.
• Experience with Spark or PySpark, SQL, and at least one major data analytics platform (Hadoop or Spark).
• Proficiency in Scala or Python.Preferred Qualifications:
  • Understanding of Design Patterns, RDBMS vs Distributed Storage tradeoffs.
  • At least 3 years of experience with Spark/PySpark, Python, Scala, and Data Engineering.
  • Experience designing tiered data architectures integrating multiple data sources.
  • Experience with data orchestration tools like Airflow (nice to have).
  • Strong problem-solving, analytical, and collaboration skills.
  • Experience developing data models, mapping rules, and data governance policies.
  • Experience with data validation, reconciliation, and documentation processes.The role involves extensive travel, sitting, and working at a computer for long periods. Communication skills via phone, email, or face-to-face are essential.Benefits include:
    • Medical, Dental, Vision, Life Insurance
    • Disability insurance
    • Reimbursement Accounts
    • Insurance options
    • 401(k) plan
    • Paid holidays and time offAbout Us: Infosys is a leader in digital services and consulting, enabling clients worldwide to navigate digital transformation with AI-powered solutions, agile digital delivery, and continuous learning and innovation.Equal Opportunity: Infosys provides equal employment opportunities regardless of race, color, sex, gender identity, sexual orientation, religion, national origin, pregnancy, veteran status, or disability.
      #J-18808-Ljbffr

Keywords: Infosys Limited, Berkeley , Spark Big Data Lead Consultant, Professions , Sunnyvale, California