V
V
valentyn_troian2018-06-06 21:03:45
Hadoop
valentyn_troian, 2018-06-06 21:03:45

How to easily connect Hadoop to a large MySQL project?

I am doing term paper. Please help me figure out which direction I should be heading.
So, I have a large MySQL database (31.3Gb, 130 million rows) on my computer. I wrote a simple html page (interface for my program). I'm using PHP to connect to my database, AJAX to fetch data asynchronously from the server, and OpenServer (local server for testing).
How it all works: The user selects some filters for a table on my html page, clicks on the search button and the table is shown to him. If there are many entries, the following pages are automatically created.
5b1821c0bbab4666480355.png
Everything works well, but what should I do to connect to my Hadoop project? This is a mandatory requirement. Maybe HortonWorks/Cloudera/Docker?
The main criterion for software is ease of configuration and installation. Also, my laptop only has 4 GB of RAM, so I'll most likely have to use older versions of the tools. HortonWorks 2.1 was successfully installed on my virtual machine (Ubuntu 14.04).
Thanks in advance to everyone for your help!

Answer the question

In order to leave comments, you need to log in

3 answer(s)
A
Alexander Aksentiev, 2018-06-06
@Sanasol

31.3Gb, 130 million lines

you need to add a couple of indexes, not a hadup.
That's when it will be 33.3TB, then look at the hadups.
https://www.chrisstucchio.com/blog/2013/hadoop_hat...

D
Dimonchik, 2018-06-06
@dimonchik2013

collaboradev.com/2010/12/10/using-hadoop-and-php
https://github.com/adprofy/Php-Hadoop-Hdfs
in short, find the client-connector
and transfer the data

M
mossat, 2018-08-14
@mossat

The easiest way is to use the built-in REST or Thrift connector for HBase.
1.Create an Hbase database
2.Enter data.
3. Enable Rest or Thrift server for Hbase
4. Install the connector and connect.
It is written in great detail in the Hbase Definition Guide

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question