¤j¼Æ¾Ú¾É½×(²Ä2ª©°ªµ¥°|®Õ¼Æ¾Ú¬ì¾Ç»P¤j¼Æ¾Ú±M·~¤¬Ápºô+³Ð·s³W¹º±Ð§÷)
¤º®e¤j¿û
¥»®Ñºò¸ò¤j¼Æ¾Ú§Þ³Nªº³Ì·sµo®i¡B«µø°ò¦ª¾ÃÑÅé¨t¡A¨t²Î¦a¤¶²Ð¤F¤j¼Æ¾Ú§Þ³N»PÀ³¥Îªº°ò¥»·§©À©M«äºû¤è¦¡¡A¸Ô²ÓÄÄz¤F¤j¼Æ¾Úªº±Ä¶°¡B¦sÀx¡B³B²z¡B¤ÀªR©M¥iµø¤Æµ¥¬ÛÃö¤º®e¡A¨Ãµ²¦X¤F³Ì·sªº§Þ³NÀ³¥Î®×¨Ò¡AÁ¿z¤F¤j¼Æ¾Ú¦bª÷¿Ä¡B¤¬Ápºô¡B¥Íª«Âå¾Çµ¥»â°ìªºÀ³¥Î¥H¤Î¤j¼Æ¾ÚÀô¹Ò¤UªºÁô¨p©M¦w¥þ°ÝÃD¡C
¥»®Ñ¬J¥i¥H§@¬°°ªµ¥°|®Õ¤j¼Æ¾Ú¡B¹q¸£¬ì¾Ç»P§Þ³N¡B³nÅé¤uµ{¤Î¬ÛÃö±M·~½Òµ{ªº±Ð§÷¡A¤]¥i¥H¨Ñ¨t²Î¤ÀªR®v¡B¨t²Î¬[ºc®v¡B³nÅé¶}µo¤uµ{®v¡B¶µ¥Ø¸g²z¤Î¹ï¤j¼Æ¾Ú§Þ³N·P¿³½ìªºÅªªÌ¾\Ū©M°Ñ¦Ò¡C
§@ªÌ¤¶²Ð
½sªÌ:¤ý¹D¥//±ZÂE¸//¸¯®Ú«¢´µ|³d½s:¾GÂù
¤ý¹D¥¡A¨k¡A1964¦~¥X¥Í¡A³Õ¤h¡C1982¦~¦Ò¤J²MµØ¤j¾Ç¹q¸£¨t¡A1999¦~¦Ü2001¦~¦b²MµØ¤j¾Ç±q¨Æ³Õ¤h¦Z¬ã¨s¤u§@¡A¬ü°ê±o§JÂÄ´µ¤j¾ÇªüÆF¹y°Ó¾Ç°|°ª¯Å³X°Ý¾ÇªÌ¡A²{¬°¥_¨Ê¬ì§Þ¤j¾Ç¸gÀÙºÞ²z¾Ç°|±Ð±Â¡C³Õ¤h¥Í¾É®v¡C¥Dn¬ã¨s¤è¦V¬°¨ÑÀ³Ãì»Pª«¬yºÞ²z¡B´¼¯àºÞ²z«H®§¨t²Îµ¥¡C©Ó¾á°ê®a¦ÛµM¬ì¾Ç°òª÷½ÒÃD2¶µ¡A¬Ù³¡¯Å½ÒÃD¦h¶µ¡A¥D½sªº±Ð§÷¡m²{¥Nª«¬y«H®§§Þ³N¡n©M¡m¨ÑÀ³Ãì³]p²z½×»P¤èªk¡n³Qµû¬°¥_¨Ê¥«°ªµ¥±Ð¨|ºë«~±Ð§÷¡C
¥Ø¿ý
²Ä1³¹ ¤j¼Æ¾Ú·§z
1.1 ¤j¼Æ¾ÚªºI´º
1.1.1 ¤¬Ápºôªº¥|¦¸®ö¼é
1.1.2 ¤j¼Æ¾ÚªºÅܲ«äºû
1.2 ¤j¼Æ¾Ú²¤¶
1.2.1 ¤j¼Æ¾Úªº·§©À
1.2.2 ¤j¼Æ¾Úªº¯S¼x
1.2.3 ¤j¼Æ¾Úªºµ²ºcÃþ«¬
1.2.4 ¤j¼Æ¾ÚªºÃöÁä§Þ³N
1.2.5 ¤j¼Æ¾Úªº®Ö¤ß²£·~Ãì
1.3 ¤j¼Æ¾Úªºµo®i©MÀ³¥Î
1.3.1 ¤j¼Æ¾Úªºµo®iºA¶Õ
1.3.2 §Ú°ê¤j¼Æ¾Úµo®i±Á{ªº°ÝÃD»P¬D¾Ô
1.3.3 ¤j¼Æ¾ÚªºÀ³¥Î
¤pµ²
²ßÃD
²Ä2³¹ ¤j¼Æ¾Úªº±Ä¶°©M¹w³B²z
2.1 ¤j¼Æ¾Úªº±Ä¶°
2.1.1 ¤j¼Æ¾Úªº±Ä¶°¨Ó·½
2.1.2 ¤j¼Æ¾Úªº±Ä¶°¤èªk
2.1.3 ¤j¼Æ¾Úªº±Ä¶°¥¥x
2.2 ¤j¼Æ¾Úªº¹w³B²z§Þ³N
2.2.1 ¼Æ¾Ú²M¬~
2.2.2 ¼Æ¾Ú¶°¦¨
2.2.3 ¼Æ¾ÚÅÜ´«
2.2.4 ¼Æ¾ÚÂk¬ù
2.3 ¼Æ¾ÚÜ®w»PETL¤u¨ã
2.3.1 ¼Æ¾ÚÜ®wªº²Õ¦¨
2.3.2 ¼Æ¾ÚÜ®wªº¼Æ¾Ú¼Ò«¬
2.3.3 ±`¥ÎªºETL¤u¨ã
¤pµ²
²ßÃD
²Ä3³¹ ¤j¼Æ¾Ú¦sÀx
3.1 ¶Ç²Î¦sÀx
3.1.1 µwºÐ
3.1.2 ª½³s¦¡¦sÀx
3.1.3 ºô¸ô¦sÀx
3.2 ¤À´²¦¡¦sÀx
3.2.1 ¦sÀxµ²ºc
3.2.2 ¨t²Î¬[ºc
3.2.3 ¨å«¬¨t²Î
3.3 ¶³¦sÀx
3.3.1 ¶³¦sÀxªºµ²ºc¼Ò«¬
3.3.2 ¶³¦sÀxªº¤ÀÃþ
3.3.3 ¶³¦sÀxªºÀu¶Õ©M¦H¶Õ
3.3.4 ¶³¦sÀxªºµo®iÁͶÕ
¤pµ²
²ßÃD
²Ä4³¹ ¤j¼Æ¾Ú³B²z»Ppºâ
4.1 Hadoop³B²z®Ø¬[
4.1.1 HDFS
4.1.2 MapReduce
4.1.3 YARN
4.1.4 ZooKeeper
4.2 Spark³B²z®Ø¬[
4.2.1 Scala
4.2.2 Spark SQL
4.2.3 Spark Streaming
4.3 Storm¶}·½¬ypºâ®Ø¬[
4.3.1 Stormªº°ò¥»·§©À
4.3.2 Spout©MBolt
4.3.3 Topology
¤pµ²
²ßÃD
²Ä5³¹ ¤j¼Æ¾Ú¤ÀªR
5.1 ¤j¼Æ¾Ú¤ÀªRªºÃþ«¬
5.1.1 ´yz©Ê¤ÀªR
5.1.2 ±´¯Á©Ê¤ÀªR
5.1.3 ÅçÃҩʤÀªR
5.2 ¤j¼Æ¾Ú¤ÀªRªº¤èªk
5.2.1 ¦^Âk¤ÀªR
5.2.2 ÃöÁp¤ÀªR
5.2.3 ¤ÀÃþ
5.2.4 »EÃþ
5.3 ¤j¼Æ¾Ú¤ÀªRªº¤u¨ã
5.3.1 Excel
5.3.2 R
5.3.3 RapidMiner
5.3.4 KNIME
5.3.5 Weka
¤pµ²
²ßÃD
²Ä6³¹ ¤j¼Æ¾Ú¥iµø¤Æ
6.1 ¤j¼Æ¾Ú¥iµø¤Æ·§z
6.1.1 ¤j¼Æ¾Ú¥iµø¤Æªº·§©À
6.1.2 ¥iµø¤Æªº°_·½
6.1.3 ¤j¼Æ¾Ú¥iµø¤Æªº§@¥Î
6.2 ¤j¼Æ¾Ú¥iµø¤Æªº§Þ³N
6.2.1 °ò©ó¹Ï§Îªº¥iµø¤Æ§Þ³N
6.2.2 °ò©ó¥¦æ§¤¼Ðªkªº
¥iµø¤Æ§Þ³N
6.2.3 ¨ä¥L¤j¼Æ¾Ú¥iµø¤Æ§Þ³N
6.3 ¤j¼Æ¾Ú¥iµø¤Æªº¤u¨ã
6.3.1 ¤Jªù¯Å¤u¨ã
6.3.2 «H®§¹Ïªí¤u¨ã
6.3.3 ¦a¹Ï¤u¨ã
6.3.4 ®É¶¡½u¤u¨ã
6.3.5 °ª¯Å¤ÀªR¤u¨ã
6.4 ¤j¼Æ¾Ú¥iµø¤Æªºµo®i
6.4.1 ¤j¼Æ¾Ú¥iµø¤Æ±Á{ªº¬D¾Ô
6.4.2 ¤j¼Æ¾Ú¥iµø¤Æªºµo®i¤è¦V
6.4.3 ¤j¼Æ¾Ú¥iµø¤Æ¥¼¨ÓªºÀ³¥Î
¤pµ²
²ßÃD
²Ä7³¹ ¤j¼Æ¾ÚÀ³¥Î
7.1 ¤j¼Æ¾Ú¦bª÷¿Ä»â°ìªºÀ³¥Î
7.1.1 ¤j¼Æ¾Ú»P«È¤áºÞ²z
7.1.2 ¤j¼Æ¾Ú»P·ÀIºÞ±±
7.1.3 ¤j¼Æ¾Ú»P¹BÀçÀu¤Æ
7.2 ¤j¼Æ¾Ú¦b¤¬Ápºô»â°ìªºÀ³¥Î
7.2.1 ¤j¼Æ¾Ú»P¹q¤l°Ó°È
7.2.2 ¤j¼Æ¾Ú»PªÀ¥æ´CÅé
7.2.3 ¤j¼Æ¾Ú»P¹s°â¦æ·~
7.3 ¤j¼Æ¾Ú¦b¥Íª«Âå¾Ç»â°ìªºÀ³¥Î
7.3.1 ¤j¼Æ¾Ú»P¬y¦æ¯f¹w´ú
7.3.2 ¤j¼Æ¾Ú»P´¼¼zÂåÀø
7.3.3 ¤j¼Æ¾Ú»P¥Íª««H®§¾Ç
7.4 ¤j¼Æ¾Ú¦b¨ä¥L»â°ìªºÀ³¥Î
7.4.1 ¤j¼Æ¾Ú»P´¼¼zª«¬y
7.4.2 ¤j¼Æ¾Ú»P¨T¨®¦æ·~
7.4.3 ¤j¼Æ¾Ú»P¤½¦@ºÞ²z
7.4.4 ¤j¼Æ¾Ú»P±Ð¨|¦æ·~
¤pµ²
²ßÃD
²Ä8³¹ ¤j¼Æ¾ÚÁô¨p»P¦w¥þ
8.1 ¤j¼Æ¾Ú±Á{ªºÁô¨p»P¦w¥þ°ÝÃD
8.1.1 ¤j¼Æ¾ÚÁô¨p»P¦w¥þªº©w¸q
8.1.2 ¼vÅT¤j¼Æ¾ÚÁô¨p»P¦w¥þªº¥Dn¦]¯À
8.1.3 ¤j¼Æ¾ÚÁô¨p»P¦w¥þ°ÝÃDªº¤ÀÃþ
8.2 ¤j¼Æ¾ÚÁô¨p»P¦w¥þªº¨¾Å@µ¦²¤
8.2.1 ¦sÀx¦w¥þµ¦²¤
8.2.2 À³¥Î¦w¥þµ¦²¤
8.2.3 ºÞ²z¦w¥þµ¦²¤
8.3 ¤j¼Æ¾ÚÁô¨p»P¦w¥þªº¨¾Å@§Þ³N
8.3.1 ¼Æ¾Ú±Ä¶°»P¦sÀx¦w¥þ§Þ³N
8.3.2 ¼Æ¾Ú«õ±¸¦w¥þ§