BigData / Hadoop Developer
- Contract
Company Description
InfoSmart Technologies is Software development and consulting company
Job Description
Application support, training and enablement for all Data Lake tools, common services, reports & management. Will become prime for user access management, audit control from the standpoint of who has access to use what, globally. Skills: 2-5 yrs java / html5 mysql|oracle javascript development; ideally experienced with AT&T ITUP, compliance and IT organizations; highly organized and proactive self-starter who communicates well verbally and in writing. Can come from mobility application development, API development, or any web application development background.
Desired: web-design background | user experience
Analytic/ETL/data management tools POC test and productionalization for ITO data center. Strong Linux OS managementinstallation knowledge + packaging, testing, security for systems design and deploy. Tools are such things like: Jetty, Tomcat, R, Python, Java, MySQL, Syncsort, Informatica, Rainstor, Talend, etc. Should be comfortable picking up any new open source or packaged application, read the admin and installation guides, be able to support hardware design requirements efforts, install the software, configure it to work and be accessed securely, troubleshoot and hand requirements back to development teams internally and in open source community; design environments for scale. All of these are heavy superuser applications for dedicated ETL developers, advanced analytics and data scientist team members. Smallish teams -25-50 per team – but many of them. We’re POC’ing, testing, packaging for repeatable templates that can be used over and over again.
Senior Java developer (5-10+ years hands on design/development experience) with 1-2 years developing in Apache Hadoop environment.
Senior Security developer/architect (10+ years design/architecture/hands-on development of security frameworks) in a common services SOA environment with extensive experience working with real time streaming, API, HTTP/HTTPs, cloud environments, linux and Apache open source platforms.
(4) Operations Support folks
(4) Hadoop/Linux administrators.
Desired: web-design background | user experience
Analytic/ETL/data management tools POC test and productionalization for ITO data center. Strong Linux OS managementinstallation knowledge + packaging, testing, security for systems design and deploy. Tools are such things like: Jetty, Tomcat, R, Python, Java, MySQL, Syncsort, Informatica, Rainstor, Talend, etc. Should be comfortable picking up any new open source or packaged application, read the admin and installation guides, be able to support hardware design requirements efforts, install the software, configure it to work and be accessed securely, troubleshoot and hand requirements back to development teams internally and in open source community; design environments for scale. All of these are heavy superuser applications for dedicated ETL developers, advanced analytics and data scientist team members. Smallish teams -25-50 per team – but many of them. We’re POC’ing, testing, packaging for repeatable templates that can be used over and over again.
Senior Java developer (5-10+ years hands on design/development experience) with 1-2 years developing in Apache Hadoop environment.
Senior Security developer/architect (10+ years design/architecture/hands-on development of security frameworks) in a common services SOA environment with extensive experience working with real time streaming, API, HTTP/HTTPs, cloud environments, linux and Apache open source platforms.
(4) Operations Support folks
(4) Hadoop/Linux administrators.
Hadoop/HBase administrator
Description:
This person will assume a senior role in the group directing technology strategy related to big data projects. The candidate will answer technological questions related to Hadoop and HBase ecosystems. For e.g. he/she will be responsible for addressing questions related to usage of HBase vs Hive for a particular requirement, best approach for loading large amount of data, comparison of Vertica, Hive and HBase for particular application, security configuration for optimal access control in Hadoop/HBase, to name a few. Additionally, the person shall be well versed in newer technology such as Kafka and Storm. The candidate needs to know under what situations will the implementation of these new technologies will make the most sense. In other words, the candidate should be able to state where these technologies are not beneficial.
Duration: 2 Years+
Location: Dallas, Atlanta, San Ramon
Skills:
· Linux administration - most important skill. Familiarity with process management on Linux.
· Programming background - should have programmed at least a little in either (Java/C/C++ ) or a scripting language such as (Perl/Python). This is in addition to Bash.
· Enterprise architecture patterns - list basic architecture patterns such as 3 tiered architecture, SaaS, distributed databases and their mechanics, Web Application and its components such as web application server and database. Data movement or ETL applications, how to source data from multiple disparate sources and protocols such as SFTP/FTP/HTTP/JDBC/Streaming etc.
· Hadoop - Should be familiar with reasons for a software such as Hadoop, the role it plays in an enterprise system, architecture of Hadoop, how does Hadoop achieve distributed capabilities etc.
· HBase - Architecture of HBase and how it differs from Hadoop. Compare and contrast HBase with Cassandra. Compare HBase/Hadoop to Storm and Kafka. Hands-on experience managing/administering components of Hadoop and HBase.
· Java administration - familiarity with java processes and their management from administration perspective. Ability to perform thread dump, JMX monitoring of a java process, analyzing thread dumps.
· Communication - Both written and verbal communication skills are important since the topics are new and many colleagues may not have the familiarity with these technologies. Consequently, strong communication is required to convey the point across to colleagues as well as managers who may be non-technical.
Additional Information
Corp to Corp
By clicking the link above or any third-party link within this posting, you are leaving this site and going to a third-party website where the third-party website's terms and privacy policy apply