Pyspark Developer

Pyspark Developers

Experience: 4 -7 Years

Location: Chennai / Bangalore

Develop Big Data applications using -Pyspark on Hadoop, Hive and/or Kafka, HBase, MongoDB

Build Machine Learning models

Deployment on Cloud platforms

Total IT / development experience of minimum 4+ years of Big Data.

Experience in -Pyspark developing Big Data applications on Hadoop, Hive and/or Kafka, HBase, MongoDB

Deep knowledge of Pyspark and libraries to develop and debug complex data engineering challenges

Experience in developing sustainable data driven solutions with current new generation data technologies to drive our business and technology strategies

Exposure in deploying on Cloud platforms

Development experience on designing and developing Data Pipelines for Data Ingestion or Transformation using -Pyspark

Development experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC), Resource Management, Distributed Processing and RDBMS

Developing applications in Agile with Monitoring, Build Tools, Version Control, Unit Test, TDD, CI/CD, Change Management to support DevOps

Development experience with SQL and Shell Scripting experience

Banking domain knowledge

Hands-on experience in SAS toolset / statistical modelling migrating to Machine Learning models

Digital Marketing Machine Learning models and use cases

ETL / Data Warehousing and Data Modelling experience prior to Big Data experience

Deep knowledge on AWS stack for big data and machine learning

Company: Maveric Systems

Company Website :

Type: Permanent

PositionAb Initio Developer.

Location - Chennai, Bangalore.

Work Mode - Hybrid Model (3 days/week)

Job Description:

ETL /Ab Initio Skills: Development experience in GDE, Express-It or any other ETL tool

Exposure to Data Analysis

Experience in Requirements Analysis, Data Analysis, Application Design, Application Development, Implementations and Testing of Data warehousing business systems.

Solid experience in developing Ab Initio applications for Extraction, Transformation, Cleansing and Loading into Data Warehouse/Data mart.

Strong experience on developing re-usable generic applications for high-volume DWH environment.

Experience on development and maintenance of schemas, Fact Tables, Dimensional Tables (Type 1, Type 2, Type 3), and Surrogate Keys.

Extensively used Ab Initio EME data store/sandbox for version control, code promotion, and impact analysis or any other ETL tool

Experience in providing Business Intelligence solutions in Data Warehousing in Windows and UNIX platforms.

Experience in writing UNIX Shell Scripts.

Experience in integration of various data sources with Multiple Relational Databases like Oracle, SQL Server and Worked on integrating data from flat files and spreadsheets.

Ability to solve problems and identify opportunities through analytical thinking.

Good knowledge of Advanced MS Excel tools is a must for reporting and analysis.

Strong attention to detail and has ability to learn quickly.

Excellent communication skills with good command over English language (verbal & written).

Ability to work independently and in a team environment.

Best Regards,

Anandhi | HR Recruiter

8925516041 |

Krishpar Technologies

E.Mail - [Confidential Information]