Answer the question
In order to leave comments, you need to log in
How to easily connect Hadoop to a large MySQL project?
I am doing term paper. Please help me figure out which direction I should be heading.
So, I have a large MySQL database (31.3Gb, 130 million rows) on my computer. I wrote a simple html page (interface for my program). I'm using PHP to connect to my database, AJAX to fetch data asynchronously from the server, and OpenServer (local server for testing).
How it all works: The user selects some filters for a table on my html page, clicks on the search button and the table is shown to him. If there are many entries, the following pages are automatically created.
Everything works well, but what should I do to connect to my Hadoop project? This is a mandatory requirement. Maybe HortonWorks/Cloudera/Docker?
The main criterion for software is ease of configuration and installation. Also, my laptop only has 4 GB of RAM, so I'll most likely have to use older versions of the tools. HortonWorks 2.1 was successfully installed on my virtual machine (Ubuntu 14.04).
Thanks in advance to everyone for your help!
Answer the question
In order to leave comments, you need to log in
31.3Gb, 130 million lines
collaboradev.com/2010/12/10/using-hadoop-and-php
https://github.com/adprofy/Php-Hadoop-Hdfs
in short, find the client-connector
and transfer the data
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question