BIG DATA DEVELOPER - II
The Judge Group Inc.

Grand Prairie, Texas


Location: Grand Prairie, TX
Description: Our client is currently seeking a BIG DATA DEVELOPER - II

JOB TITLE:

Description

BigData Architect with a minimum of 6+ years of experience to join our Datalake team. They will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure Data Platform runs 24/7.

• Possess extensive analysis, design and development experience in Hadoop and AWS Big Data platforms

• Able to critically inspect and analyze large, complex, multi-dimensional data sets in Big Data platforms

• Experience with Big Data technologies, distributed file systems, Hadoop, HDFS, Hive, and Hbase

• Define and execute appropriate steps to validate various data feeds to and from the organization

• Collaborate with business partners to gain in-depth understanding of data requirements and desired business outcomes

• Create scripts to extract, transfer, transform, load, and analyze data residing in Hadoop and RDBMS including Oracle and Teradata

• Design, implement, and load table structures in Hadoop and RDBMS including Oracle and Teradata to facilitate detailed data analysis

• Participate in user acceptance testing in a fast-paced Agile development environment

• Troubleshoot data issues and work creatively and analytically to solve problems and design solutions

• Create documentation to clearly articulate designs, use cases, test results, and deliverables to varied audiences

• Create executive-level presentations and status reports

• Under general supervision, manage priorities for multiple projects simultaneously while meeting published deadlines

• Bachelor's degree or Master's degree in Computer Science or equivalent work experience

• Highly proficient and extensive experience working with relational databases, particularly Oracle and Teradata

• Excellent working knowledge of UNIX-based systems

• Excellent Interpersonal, written, and verbal communication skills

• Very proficient in the use of Microsoft Office or G Suite productivity tools

• Experience with designing solutions and implementing IT projects

• Exposure to DevOps, Agile Methodology, CI/CD methods and tools, e.g. JIRA, Jenkins, is a huge plus

• Prior work experience in a telecommunications environment is a huge plus

• Experience with Spark, Scala, R, and Python is a huge plus

• Experience with BI visualization tools such as Tableau and Qlik is a plus

• Background in financial reporting, financial planning, budgeting, ERP (Enterprise Resource Planning) is a plus

• Exposure to advanced analytics tools and techniques e.g. machine learning, predictive modeling is a plus.

MUST HAVE SKILLS (Most Important):

• Experience with Hadoop Data Platforms Experience with Relational databases like Oracle

• SQL/PLSQL

• Unix Shell Script

• CRONJOB

• HIVE

DESIRED SKILLS:

• Python

• Java

• Hive and Spark cluster environments

• Qlik Sense

JOB DUTIES:

Install and configure Hadoop clusters, Sqoop,Python & Spark packages Expertise in administration of Hive, Kafka, Python, Hbase, Spark, Sqoop Manage Hadoop,Kafka,hbase, Sqoop,Hive and Spark cluster environments Apply proper architecture guidelines to ensure highly available services Plan and execute major platform software and operating system upgrades and maintenance across physical environments Develop and automate processes for maintenance of the environment Implement security measures for all aspects of the cluster (SSL, disk encryption, role-based access) Ensure proper resource utilization between the different development teams and processes Design and implement a toolset that simplifies provisioning and support of a

large cluster environment Review performance stats and query execution/explain plans; recommend changes for tuning Create and maintain detailed, up-to-date technical documentation Ability to shell script with Linux Integration to other Hadoop platforms

EDUCATION/CERTIFICATIONS:

Bachelors or Masters degree in Computer Science, Information Systems, Engineering, or Mathematics preferred.

Contact: ateotia@judge.com

This job and many more are available through The Judge Group. Find us on the web at www.judge.com


Job Alerts

Provide an email, zip code for jobs, and/or job category to subscribe to job alerts. Learn more now.


*By subscribing, you agree to our Terms and Privacy Policy.

More IT jobs


SoftChoice
Dallas, Texas
Posted 4 minutes ago
SoftChoice
Malvern, Pennsylvania
Posted 4 minutes ago
SoftChoice
Malvern, Pennsylvania
Posted 4 minutes ago
View IT jobs »

New post from our employment blog

New Post

Find Your Fit: How to Screen for the Best Company Culture

What are the most important features of a job to you? Salary, benefits, and location probably rank pretty high but what about company culture?...

Read blog post
Share this inclusion job with the community

Click a community link below, and then social share the BIG DATA DEVELOPER - II job.


Disability inclusion jobs logo
Asian inclusion jobs logo
Black inclusion jobs logo
Diversity inclusion jobs logo
LGBTQ inclusion jobs logo
Seniors inclusion jobs logo
Women inclusion jobs logo
Hispanic inclusion jobs logo