Ê×Ò³
ѧϰ
»î¶¯
רÇø
¹¤¾ß
TVP
·¢²¼
¾«Ñ¡ÄÚÈÝ/¼¼ÊõÉçȺ/ÓŻݲúÆ·,¾¡ÔÚС³ÌÐò
Á¢¼´Ç°Íù

Julia¡¢Delta Lake°ñÉÏÓÐÃû£¡2019ÄêÓÅÐ㿪ԴÈí¼þ½±¹«²¼

Èç½ñ£¬Èí¼þ¿ª·¢¡¢ÔƼÆËã¡¢·ÖÎö¡¢»úÆ÷ѧϰÒÔ¼°¼¸ºõËùÓÐÐÂÐËÁìÓòÖÐ×îÖØÒªµÄÈí¼þ¼¸ºõ¶¼ÓµÓпªÔ´Éí·Ý¡£ÓÐʱºò£¬ÉõÖÁ´æÔÚ¶à¼Ò±Ë´Ë¼¤ÁÒ¾ºÕù£¬ÇÒ¸÷×Ô½ÔÓµÓÐÐÛºñʵÁ¦µÄ¼¼ÊõÆóÒµÔÚÖ§³ÖÕâЩ¿ªÔ´Èí¼þÏîÄ¿µÄ·¢Õ¹£¬Ï£ÍûÀûÓÃËüÃǽâ¾öÆóÒµ¼ÆËãÖдæÔÚµÄÖØ´óÄÑÌ⣬²¢½øÒ»²½ÖØËÜÆóÒµ¼¶»ù´¡ÉèÊ©ÓëÓ¦ÓóÌÐòµÄÐÂÃæò¡£

Ê®¶àÄêÒÔÀ´£¬InfoWorld Ò»Ö±ÖÂÁ¦ÓÚÆÀÑ¡ InfoWorld Bossies Äê¶ÈÓÅÐ㿪Դ´ó½±£¬Ö¼ÔÚ·¢ÏÖÄÇЩ×îÓÐȤ¡¢¾ßÓд´ÐÂÐԵĿªÔ´ÏîÄ¿¡£ÔÚ¸Õ¸Õ¿ªÊ¼ÆÀѡʱ£¬»ñ½±¿ªÔ´ÏîÄ¿ÍùÍùÌåÁ¿ºÜС£¬¶øÇÒÒ»°ãֻΪÆóÒµ¿ª·¢ÈËÔ±ÒÔ¼° IT ²¿ÃÅËùÊìÖª£¨³ýÁË Linux »òÕß BIND µÈÉÙÊýÀýÍâÇé¿ö£©¡£È»¶ø£¬ÆäÈÔÈ»¾ßÓм«¸ßµÄʵÓöȣ¬¶øÇÒÍêÈ«Ãâ·Ñ¡£

½üÈÕ£¬2019 Äê InfoWorld Bossie °ñµ¥Õýʽ¹«²¼£¬ÔÚ½ñÄêµÄ»ñ½±Ãûµ¥ÖУ¬´ó¼Ò²»½öÄܹ»ÕÒµ½È«Çò×î³öÉ«µÄ¿ªÔ´Èí¼þ£¬ËüÃÇͬʱҲ´ú±í×ÅÄ¿Ç°Èí¼þÐÐÒµµÄ½Ï¸ßË®×¼¡£

BPF Compiler Collection

À©Õ¹ Berkeley Êý¾Ý°ü¹ýÂËÆ÷£¨¼ò³Æ eBPF£©ÔÚ Linux ÊÀ½çÉÏ¿ÉνÉùÃûÏÔºÕ£¬ËüÕýÔÚÖð²½È¡´ú iptables µÈÍøÂçÖ§³Ö¹¤¾ß£¬²¢ÒÔ¸üʵÓÃÇÒ¸ü°²È«µÄ·½Ê½½µµÍ¹Û²ì¹¤¾ßÔÚÄں˿ռäÖеÄÔËÐо籾¡£

BPF Compiler Collection ÒÔ¸ßЧ¹Û²ì×÷ΪÉè¼ÆµÄºËÐÄÄ¿±ê£¬ÕâÌ×¼¯ºÏ°üº¬ÓÉ Python »ò Lua ÓïÑÔ´´½¨²¢ÔËÐеÄÒ»×é eBPF ´úÂë±àÒëÆ÷¹¤¾ß¡£¸ÃÏîÄ¿Öл¹Ìṩ´óÁ¿Ê¾Àý³ÌÐò£¬¿ÉÃæÏò´úÂëÄÚ´æ·ÖÅäÒÔ¼° HTTP Êý¾Ý°üµÈÈÎÎñÔËÐиú×Ù¼°È«Óòɸѡ¡£

Netflix ¹«Ë¾Ö÷ÄÚºËÐÔÄܹ¤³Ìʦ Brendan Gregg µÄÐÂÊ顶BPF ÐÔÄܹ¤¾ß£¨BPF Performance Tools£©¡·¼´½«³ö°æ£¬ÏàÐŽìʱÓÖ½«ÏÆÆðÐÂÒ»²¨ eBPF ÈËÆøì­Éý¡£Òò´Ë£¬ÍƼö´ó¼ÒÔÚÕⲨÀ˳±À´ÁÙ֮ǰÇÀÏÈÒ»²½Ñ§Ï°Á˽⡣

Wasmer

WebAssembly¡ª¡ª¼ò³Æ Wasm¡ª¡ª³Ðŵ´øÀ´ÉÁµç°ãµÄÆô¶¯ËÙ¶ÈÒÔ¼°¼«µÍµÄÕ¼Óÿռ䣬ÕâҲʹÆä³ÉΪÎÞ·þÎñÆ÷¼Ü¹¹ÓëÎïÁªÍø±ßÔµÉ豸µÄÀíÏëÑ¡Ôñ¡£Wasmer ÔÚ WebAssembly ·þÎñÆ÷ÔËÐÐʱÁìÓò¾ÓÓÚÁìÏȵØ룬ÆäÖ÷ÒªÓÅÊÆÌåÏÖÔÚ½Ó½üÔ­ÉúˮƽµÄÖ´ÐÐËٶȡ£ÊÂʵÉÏ£¬µ¥Æ¾ËÙ¶ÈÕâÒ»µã£¬Wasmer ¾Í×ãÒÔ¼¼Ñ¹ÈºÐÛ¡£

Wasmer ½«¸÷ÖÖ¶ÀÁ¢µÄÔËÐÐʱÓ빤¾ß°ü½áºÏÆðÀ´£¬ÓÃÓÚ±àÒë²¢¶¨Î» WebAssembly ¶þ½øÖÆ´úÂ롪¡ª°üÀ¨Ç¶ÈëÖÁÏÖÓдúÂëÖÐµÄ WWebAssembly Ä£¿é¡¢CLI ¿ÉÖ´ÐÐÓ¦ÓÃÒÔ¼°¶þ½øÖÆ¿âµÈµÈ¡£ÀàËÆÓÚ Node.js Ö®ÓÚ JavaScript£¬Wasmer ÔÊÐí WebAssembly ʵÏÖÔڹ㷺ƽ̨ÉϵÄËæ´¦ÔËÐС£

Wasmer ÒÔ Cranelift ´úÂëÉú³ÉÆ÷Ϊ»ù´¡£¬Ìṩº­¸Ç Go¡¢C/C++¡¢C#¡¢Python¡¢R¡¢Rust¡¢Ruby ÒÔ¼° PHP µÄÓïÑÔ¼¯³ÉÑ¡Ïͬʱ֧³Ö Linux¡¢Mac Óë Windows ÔËÐÐʱ£¨ÔÚ Windows ƽ̨ÉϲÉÓà Emscripten ʵÏÖ£¬Òò´ËÉд¦ÓÚʵÑé½×¶Î£©¡£Wasmer µÄÀà NPM ¹¤¾ß°ü¹ÜÀíÆ÷ WAPM ͬÑù±íÏÖ³öÉ«£¬¸ºÔðÀûÓþ­¹ýÈÏÖ¤ÇÒ¿ÉÁ¢¼´ÔËÐеĸ÷Àà¿âΪ²úÆ·´øÀ´½øÒ»²½ÍêÉÆ¡£

2019 Äêµ±ÖУ¬Wasmer ½øÒ»²½Ïò Cranelift Ìí¼ÓÁËÁ½Ìײ¹³äÐÔºó¶Ë£¨°üÀ¨Í¨¹ýÓÅ»¯ÌṩִÐÐËٶȸü¿ìµÄ LLVM ÔËÐÐʱ£©£¬Í¬Ê±Îª WASI£¨WebAssembly ϵͳ½Ó¿Ú£©Óë SIMD ²¢ÐÐÐÔÌṩ֧³Ö¡£WASI ÕýÊÇÓ¦ÓóÌÐò¿ç²Ù×÷ϵͳ¿ÉÒÆÖ²ÐÔµÄʵÏֹؼü£¬¶ø SIMD Ö§³Ö½«Îª¼ÓÃܼ°ÊÓƵ´¦ÀíµÈÊýѧÃܼ¯ÐÍÓ¦ÓôøÀ´¾Þ´óµÄÐÔÄÜÌáÉý¡£

Language Server Protocol

½üÄêÀ´£¬Èí¼þÁìÓòÖÐÓÖ³öÏÖÁ˲»ÉÙ׿ԽµÄ¹¤¾ßÁ´´´Ð³ɹû£¬ÆäÖÐµÄ LLVM ±àÒëÆ÷¿ò¼Ü¾ÍÊÇÒ»Ì×ÓÃÓÚʵÏÖ¸÷Àà±àÒëÆ÷µÄ³öÉ«¿âÑ¡Ïî¡£¶øÀ´×Ô΢ÈíµÄ Language Server Protocol ¾ÍΪÈí¼þ¿ª·¢ÈËÔ±ÌṩÁËÁíÒ»¸öÇ¿´óµÄ¹¤¾ßÊг¡£¬Äܹ»ÔÚ±àÒëÆ÷»òÕßÓïÑÔ¹¤¾ßÁ´ÓëÓÃÓÚ´´½¨´úÂëµÄ IDE »ò±à¼­Æ÷Ö®¼ä½¨Á¢Æð˳³©µÄË«ÏòͨµÀ¡£

¿ª·¢ÈËÔ±ÒªÇó×Ô¼ºµÄ±àÂ빤¾ßÄܹ»Ìṩʵʱ·´À¡¡ª¡ª³ýÁ˶Աê×¼¿âº¯Êý½øÐо²Ì¬²éÕÒÖ®Í⣬»¹Ó¦µ±°üº¬ÓëËù±àд´úÂëÏà¹ØµÄ½»»¥Ê½ÏêϸÐÅÏ¢¡£Language Server Protocol ͨ¹ýÓÃÓÚ¿ª·¢¹¤¾ßÓëÓïÑÔ·þÎñÆ÷¼äͨÐÅµÄ JSON-RPC ±ê×¼ºÜºÃµØÍê³ÉÁËÕâһĿ±ê£¬¸Ã±ê×¼ÌṩÓïÑԼǼÒÔ¼°»á»°±à¼­×Ô¶¯²¹È«µÈ¶àÖÖʵÓù¦ÄÜ¡£

´Ó Ada µ½ YANG£¬Ä¿Ç° Language Server Protocol ÒѾ­ÎªÊýÊ®ÖÖÓïÑÔÌṩʵÏÖ·½°¸¡£

Serverless Framework

ÔÚ½µµÍÔËÓª¿ªÏú·½Ã棬ûÓÐʲôÄܹ»ÔÚЧ¹ûÉÏÓëÎÞ·þÎñÆ÷¼Ü¹¹ÏàÆ¥µÐ¡£µ«Òź¶µÄÊÇ£¬½µµÍ¿ªÏúͨ³£Ò²°éËæ׿ܹ¹¸´ÔÓÐÔµÄÌáÉýÒÔ¼°Ôƹ©Ó¦ÉÌËø¶¨µÈÎÊÌâ¡£Serverless Framework ÔÚÎÞ·þÎñÆ÷Ó¦ÓóÌÐòÓë¸÷Àà¸ßÈËÆøÔÆʵÏÖ·½°¸£¨°üÀ¨ Amazon Web Services¡¢Î¢Èí Azure¡¢Google Cloud Platform ÒÔ¼° Kubernetes£©Ö®¼ä´øÀ´Á˾ßÓй©Ó¦ÉÌÖÐÁ¢ÐԵijéÏó½â¾ö·½°¸¡£

Serverless Framework ²»½öÔÊÐíÓû§×ÔÓÉÑ¡Ôñ²»Í¬µÄ²¿ÊðÄ¿±ê£¬Í¬Ê±Ò²ÄÜ°ïÖú´ó¼Ò¸ü¿ì¸üÇáËɵضÔʼþÇý¶¯Ðͺ¯Êý¼´·þÎñÓ¦ÓóÌÐò½øÐвâÊÔ¡¢²¿ÊðÒÔ¼°¹ÜÀí¡£ÔÚ´´½¨º¯Êý¡¢¶¨Òå¶Ëµã²¢Ö¸¶¨Ä¿±êÔÆ»·¾³Ö®ºó£¬Serverless Framework ¼´¿É¶ÔÄãµÄ´úÂë¡¢°²È«ÐÔÒªÇó¡¢×ÊÔ´ÒªËØÒÔ¼°ÔƲ¿Êð YAML ½øÐдò°ü£¬´Ó¶ø˳ÀûÍê³ÉÏîÄ¿²¿Êð¡£ÁíÍ⣬¸Ã¿ò¼ÜÄÚÖõÄ×Ô¶¯¼ì²â¹¦ÄÜÒ²»áÁ¢¼´¿ªÊ¼¼à¿Ø²¢²¶×½¸÷ÏîÖ¸±ê£¬´Ó¶øÌṩ¿ªÏä¼´ÓõÄ֪ͨ¹¦ÄÜ¡£

¸ÃÏîÄ¿±³ºóµÄ¿ª·¢ÈËÔ±ÃǽñÄêÖ÷ÒªÖÂÁ¦ÓÚͨ¹ýʵʱ¼à¿Ø¡¢°²È«ÐÔÓ뼯³É²âÊÔ¶Ô Serverless Framework ½øÐÐÔöÇ¿£¬´Ó¶øÈ·±£ÆäÓÐÄÜÁ¦ÉîÈëÕûºÏÖÁÓ¦ÓóÌÐòÉúÃüÖÜÆÚ¹ÜÀíµ±ÖС£ÐµĹæÔòÔÊÐíÓû§¹ÜÀíƾ֤¼°·ÃÎʲßÂÔ£¬´Ó¶øÔöÇ¿°²È«ÐÔ²¢ÒԿɱà³Ì·½Ê½¶ÔÕâЩ×ÊÔ´¼ÓÒÔÀûÓá£Ðµļ´²å¼´ÓÃ×é¼þ¼¯ºÏ£¨Ä¿Ç°ÈÔ´¦ÓÚ beta ²âÊԽ׶Σ©ÔòΪ´Ó¾²Ì¬ÍøÕ¾µ½È«Õ» Web Ó¦ÓóÌÐòµÄ¶àÖÖ³£¼ûÓÃÀý´øÀ´ÏÔÖøµÄ¹¦Äܲ¹³ä¡£

×ܶøÑÔÖ®£¬Serverless Framework Ϊ¿ª·¢ÈËÔ±´øÀ´Î޷컯ʹÓÃÌåÑ飬´Ó¶øÏû³ýÁ˹¹½¨ÎÞ·þÎñÆ÷Ó¦ÓóÌÐòÖеĶàÖÖ³£¼ûÄÑÌâÓëÏÝÚå¡£

Istio

΢·þÎñ¼Ü¹¹Äܹ»¼ò»¯¿ª·¢Á÷³Ì£¬µ«Ëæ×Å·þÎñÊýÁ¿µÄ±¬Õ¨Ê½Ôö³¤£¬¶Ô¸÷·þÎñ¼äͨÐŵĹÜÀíÒ²±äµÃÓú·¢¸´ÔÓ¡£Ö²¸ùÓÚ Kubernetes Éú̬µÄ Istio ͨ¹ý½«·¢ÏÖ¡¢¸ºÔؾùºâ¡¢·ÃÎÊ¿ØÖÆ¡¢¼ÓÃÜ¡¢Á÷Á¿¹ÜÀíÒÔ¼°¼à¿ØµÈ¹¦Äܼ¯³ÉÖÁ»ù´¡ÉèÊ©²ã¼¶µÄ½â¾ö·½°¸µ±ÖУ¬ÏÔÖø¼õÇáÁË¿ª·¢ÈËÔ±µÄ·þÎñ¼äͨПºµ£¡£»»ÑÔÖ®£¬¿ª·¢ÈËÔ±½«ÎÞÐèÊÖ¶¯ÔÚ·þÎñµ±ÖÐÓ¦ÓÃÕâЩ¹ÜÀíÂß¼­¡£

Istio Á¢×ãÒ»ÕûÌ× Kubernetes ¼¯Èº£¨³£±»³ÆΪ¡¸·þÎñÍø¸ñ¡¹£©¶Ô¸÷ÈÝÆ÷Óë±àÅÅ·þÎñ¼ÓÒÔ¹ÜÀí¡£ÆäÀûÓà Envoy ´úÀí¡°±ß³µ¡±³äµ±·þÎñÍø¸ñµ±Öи÷·þÎñ¼äËùÓÐͨÐŵĴúÀí»úÖÆ¡£Óû§¿ÉÒÔͨ¹ý¸ß¼¶³éÏó¶Ô¼¯ÈºÖеÄÍøÂç½øÐÐËæÒâ±ä¸ü£¬¶øºóÖð²½ÍƳö£¬²¢ÔÚ·¢ÏÖÎÊÌâÖ®ºóÁ¢¼´»Ø¹ö¡£Istio »¹Äܹ»Éú³ÉÓëÁ÷Á¿»î¶¯Ïà¹ØµÄͳ¼ÆÐÅÏ¢£¬°ïÖú´ó¼Ò¿ìËÙ»ñµÃ·ûºÏÐèÒªµÄ·þÎñÐÔÄÜ¡£

Envoy

×÷Ϊ Kubernetes µÄ±ê×¼·þÎñ´úÀí£¬Envoy Ò»Ö±ÔÚ²»¶Ï·¢Õ¹×³´ó¡£ÔÚ³ÉΪÊ׸öÔÆÔ­Éú¼ÆËã»ù½ð»áÏîÄ¿£¨ÉõÖÁÔçÓÚ Prometheus Óë Kubernetes£©Ö®ºó£¬Envoy ¿ìËÙ½øÈë Istio Óë AWS App Mesh µÈ·þÎñÍø¸ñµÄºËÐÄ£¬²¢³ÉΪ´ó²¿·Ö Kubernets ÉèÖÃÖв»¿É»òȱµÄ×é³É²¿·Ö¡£×ãÒÔÓë Reddit ±È¼çµÄ´ó¹æÄ£Éú²ú²¿Êð£¬Ò²Ôڿ͹۲ãÃæÖ¤Ã÷ÁË Envoy ³öÉ«µÄ¹æÄ£»¯ÔË×÷ÄÜÁ¦¡£

¹ýÈ¥Ò»Ä꣬ÎÒÃÇÓ­À´ÁË Envoy Mobile£¬¸Ã°æ±¾½« Envoy µÄÖî¶àÓÅÊÆ£¨°üÀ¨¶Ï·¡¢ÖØÊÔ´¦Àí¡¢¿É¹Û²ìÐÔÓëÒ»ÖÂÐԵȣ©ÒýÈë iOS Óë Android ͳһ¿çƽ̨¿âµ±ÖС£¾¡¹ÜÉд¦ÓÚÔçÆÚ·¢²¼½×¶Î£¬ÎÒÃǶÔÓÚ Envoy Mobile ÔÚ 2020 ÄêµÄ±íÏÖÒѾ­³äÂúÆÚ´ý¡£

Kong

Èç¹û´ó¼ÒµÄÖ÷Òª¹¤×÷Êǹ¹½¨ API£¬ÄÇôËÙÂÊÏÞÖÆ¡¢¸ºÔؾùºâ¡¢Éí·ÝÑéÖ¤¡¢ÈÕÖ¾¼Ç¼µÈ¹¦ÄÜÍêÈ«²»ÐèÒªÖØÐÂʵÏÖ¡£Kong ÓÉ Mashape£¨¼´ÏÖÔÚµÄ Kong ÓÐÏÞ¹«Ë¾£©ÓÚ 2015 ÄêÍÆÏò¿ªÔ´£¬ÆäÄܹ»ÌṩÕâÀïÌáµ½ÒÔ¼°Ã»ÓÐÌáµ½µÄ·á¸»¹¦ÄÜ¡£´ËÍ⣬¸Ã¹«Ë¾»¹Ìṩ Kong Enterprise£¬Ò»Ì×»ùÓÚ¿ªÔ´Äں˹¹½¨µÄÆóÒµ¼¶ API ƽ̨¡£

Kong ÒÔ¿ªÏä¼´Ó÷½Ê½ÎªÎÒÃÇÌṩӦÓóÌÐò¶ÑÕ»ÄÚ API ¼¯ËùÐèÒªµÄ´ó²¿·Ö¹¦ÄÜ¡£³ýÁË֮ǰÌáµ½µÄÖ÷Òª¹¦ÄÜÖ®Í⣬Æ仹°üº¬¶Ï·Æ÷¡¢ÔËÐÐ״̬¼ì²é¡¢OAuth¡¢×ª»»¡¢»º´æ¡¢µØÀíλÖø´ÖƵȹ¦ÄÜ¡£¼´Ê¹Î´ÄÜĬÈÏÌṩ£¬´ó¼ÒÒ²ÍêÈ«¿ÉÒÔͨ¹ý Kong Hub ´ÓÊýÊ®¿î²å¼þÖÐÕÒµ½×Ô¼ºÐèÒªµÄÆäËüСÖÚ¹¦ÄÜ¡£

Kong »¹Äܹ»Óë¸÷ÀàÔÆÔ­Éú¹¤¾ßЭͬºÏ×÷¡£Ï£Íû½« Kong Óë×Ô¼º¼¯Èº½ôÃܼ¯³ÉµÄ Kubernetes Óû§£¬¿ÉÒÔʹÓà Kubernetes Ingress Controller for Kong£¬´Ó¶ø¿ìËÙÏíÊÜ´óÁ¿ÏÖ³ÉÇÒ³ÉÊìµÄ¹¦ÄÜ¡£Kong Enterprise °æ±¾²»½öÓµÓиüÇ¿´óµÄÖ§³ÖÄÜÁ¦£¬Í¬Ê±Ò²Ìṩרҵ¼¶µÄ×Ô¶¯»¯Óë¿É¼ûÐÔ¹¤¾ß¡£

Pulumi

Ò»°ãÀ´½²£¬IT »ù´¡ÉèʩҪôÐèÒªÒÔÊÖ¶¯·½Ê½Æ´´ÕÆðÀ´£¨·Ç³£·ÑÁ¦£©£¬ÒªÃ´ÊÇͨ¹ýÐèÒªµ÷ÓÃÊýÊ®¸ö API µÄ½Å±¾×é×°ÔÚÒ»Æ𣨼«Îª¸´ÔÓ£©£¬»òÕßÊÇͨ¹ý Terraform µÈ¹¤¾ßÖ´ÐÐÅäÖÃÎļþ£¨¸ß¶ÈרÓû¯£©¡£Pulumi ÌṩÁËÒ»ÖÖÓëÖÚ²»Í¬¡¢Í¨ÓöȸßÇÒ»ù±¾Ë¼Â··Ç³£¼òµ¥µÄ·½°¸£¬Äܹ»°ïÖúÎÒÃÇÇáËɽâ¾ö¸÷À༯³É¹ý³ÌÖеij£¼ûÎÊÌâ¡£´ó¼Ò²»±ØÃãÁ¦Ê¹ÓÃÁîÈËÀ§»óµÄй¤¾ß»ò±¿×¾¾É¹¤¾ßµÄ×éºÏ£¬¶ø¿ÉÒÔÑ¡ÔñÄã×îÊìϤÇÒϲ°®µÄ³£¹æ±à³ÌÓïÑÔÒÔ±à³Ì·½Ê½½øÐлù´¡ÉèÊ©ÉùÃ÷¡£Êǵģ¬ÍêÈ«ÎÞÐè YAML£¡

×îÖØÒªµÄÊÇ£¬Pulumi ÔÊÐí´ó¼ÒÒÔÏàͬµÄ·½Ê½ÔÚÈ«²¿Ö÷Á÷ÔÆ·þÎñ£¨Amazon¡¢Azure¡¢Google£©ÒÔ¼°Ò»ÇÐ Kubernetes ϵͳµ±ÖÐʵÏÖ»ù´¡ÉèÊ©µÄÅäÖÃÓë¹ÜÀí¡£½«ÔƶÔÏóÄ£ÐÍ¡¢ÔËÐÐʱÆÀ¹ÀÒÔ¼°ËùÐè״̬Ïà½áºÏ£¬Pulumi ÔÊÐí´ó¼Ò¿çÔÆÅäÖò¢¹ÜÀí¸÷Àà×ÊÔ´£¬°üÀ¨ÎÞ·þÎñÆ÷´úÂëƬ¶Î¡¢¾²Ì¬ÍøÕ¾ÒÔ¼°¸÷Àà³£¼ûµÄÓ¦ÓóÌÐò»òÓ¦ÓÃģʽ¡£

Pulumi ´úÂë¿ÉÒÔʹÓà JavaScript¡¢TypeScript¡¢Python ÒÔ¼° Go ÓïÑÔ½øÐбàд£¬ÆäÖк­¸Ç¾ø´ó¶àÊýÆóÒµÓÃÀý¡£ÁíÍ⣬ÏîÄ¿µÄʾÀý¿âÖÐÒ²°üº¬¶àÖÖÄܹ»Ö±½ÓʹÓûòÕßÀ©Õ¹µÄ³£ÓÃģʽ¡£

Sysdig

Kubernetes Óë Cloud Foundry µÈÔÆÔ­Éú¼¼ÊõÒѾ­·Ç³£¸´ÔÓ£¬¶øÒ»µ©½«Î¢·þÎñ¼Ü¹¹ÒýÈëÕâÌ××éºÏ£¬ÄÇô¼à¿Ø¹¤×÷µÄÄѶȽ«ÌáÉýµ½ÐµÄˮƽ¡£Sysdig ΪÎÒÃÇÌṩһ×鹤¾ß£¬²»½ö¿ÉÒÔÓÃÓÚÁ˽â»ùÓÚÈÝÆ÷µÄÓ¦ÓóÌÐòµÄʵ¼ÊÐÔÄÜ£¬Í¬Ê±Ò²¿É°ïÖú´ó¼Ò¼°Ê±·¢ÏÖ¸÷ÀàÒì³£×´¿öÓ밲ȫÍþв¡£

Sysdig Inspect Äܹ»Á¢×ãÄں˲㼶½øÐÐÈÝÆ÷״̬²¶×½£¬°ïÖú´ó¼Ò¼°Ê±·¢ÏÖÐÔÄÜÎÊÌâ¡¢¸ú×ÙÇ÷ÊÆ£¬²¢ÔÚ·¢ÉúÑÏÖØÐÔÄÜÆ¿¾±Ö®Ç°½øÐйÊÕÏÅŲ顣¶øÀûÓà Sysdig Falco£¬Äã¿ÉÒÔΪÈÝÆ÷¶¨Òå¡°³£¹æ¡±»î¶¯£¬Falco »ùÓÚ¹æÔòµÄ¹ýÂËÒýÇ潫ÔÚ¼ì²âµ½Òì³£ÐÐΪʱ´¥·¢¾¯±¨£¬ÉõÖÁ¿ÉÒÔ¸ù¾ÝÔ¤ÉèÖ´Ðй涨²Ù×÷¡£Sysdig Prometheus Ôò½áºÏÁ˼¸ºõº­¸ÇËùÓÐÖ¸±êµÄ¼ì²â¹¦ÄÜ£¬¿ÉÌṩ¼«ÎªÇáËɵIJéѯÓëʵʱ¿ÉÊÓ»¯ÄÜÁ¦£¬ÓÃÒÔ»ã×ÜÀ´×Ô·Ö²¼Ê½ÈÝÆ÷¡¢Ó¦ÓóÌÐòÒÔ¼°·þÎñµÄÔËÐÐʱÊý¾Ý¡£

¹ýÈ¥Ò»ÄêÀ´£¬¸ÃÏîÄ¿¶Ô¾¯±¨×Ô¶¨ÒåÓë´¥·¢Æ÷×ö³ö¸Ä½ø£¬Í¬Ê±ÌáÉýÁËÒDZí°åµÄÉî¶ÈÓëϸÁ£¶Èˮƽ£¨Ôö¼ÓÁËÖîÈç CPU/ ÄÚ´æʹÓÃÂÊÒÔ¼°ÈÝÁ¿ãÐÖµµÈÐÅÏ¢£©£¬Í¬Ê±ÔöÇ¿ÁË°²È«²ßÂԱ༭Æ÷ÖÐÏÔʾµÄ̧ͷ¹æÔò¡£

ÈÝÆ÷»¯Ó¦ÓóÌÐò´øÀ´Á˶ÀÌصÄÐÔÄÜÌôÕ½Ó멶´¡£Sysdig ¹¤¾ßÎÞÒÉÄܹ»°ïÖúÎÒÃǸüΪÑÏÃܵع۲ìÈÝÆ÷ÐÔÄÜÓ밲ȫÐÔ±íÏÖ¡£

Kraken

´ó¹æÄ£ÈÝÆ÷²¿Êð×ÜÊÇÓë´óÁ¿ Docker ¾µÏñ´«ÊäÃܲ»¿É·Ö£¬ÕâÒâζ×ÅÎÒÃDZØÐëÃæ¶ÔÓÉ´Ë´øÀ´µÄÑÓ³Ù·åÖµÓëÀ©Õ¹ÌôÕ½£¬ÌرðÊÇÔÚÐèÒª¿ç¶à¸öÇøÓòµÄÊý¾ÝÖÐÐĽøÐоµÏñÌáÈ¡µÄ³¡¾°Ö®Ï¡£ÎÒÃǸÃÈçºÎÓ¦¶ÔÕâÒ»ÄÑÌ⣿¶Ô Uber µÄ¹¤³ÌÍŶÓÀ´Ëµ£¬´ð°¸¾ÍÊÇ Kraken¡£

Kraken ?ÊÇÒ»Ì×ÃæÏò Docker ×¢²á±íµÄ¸ß¿ÉÀ©Õ¹ÐԶԵȻº´æÓë·Ö·¢²ã£¬Äܹ»ÔÚ¼¸ÃëÖÓÖ®ÄÚÍê³É TB ¼¶¾µÏñÊý¾ÝµÄÌáÈ¡¡£Kraken µÄºËÐÄΪ°üº¬Èý´óÖ÷Òª×é¼þµÄ×ÔÎÒÐÞ¸´ÐÍ torrent ÖÖ×Ӽܹ¹¡£Ô´ÖÖ×ӽڵ㻺´æÊ×Ïȴӿɲå°ÎµÄºó¶Ë Blob ´æ´¢£¨ÀýÈç Amazon S3 »òÕß HDFS£©µ±ÖÐÌáÈ¡¾µÏñÊý¾Ý¡£¸ú×ÙÆ÷½ÚµãËæºó´´½¨ËùÓпÉÓöԵȷ½Óë·¢ÖÖ·½µÄÄÚ´æÈ«¾ÖÊÓͼ¡£¶ÔµÈ·½¸ºÔðʵÏÖ Docker ×¢²á±í½Ó¿Ú²¢×ÔÖ÷Ö´ÐоµÏñ pull ÇëÇó¡£

¸÷¶ÔµÈ½Úµã²¢Ðй¤×÷£¬¿ÉÔÚ¼¸ÃëÖÓÖ®ÄÚ×é×°³ö³ÉǧÉÏÍò¸ö GB ¼¶±ð´óСµÄ Blob£¬ÕâÑùµÄËٶȱíÏֱȴ«Í³¼¯ÖÐʽע²á±í¸ß³öÊý¸öÁ¿¼¶¡£Kraken »¹ÌṩÁ¼ºÃµÄÓÅ»¯Óëµ÷Õû²ÎÊý£¬ÒÔ±ÜÃâÔì³ÉÍøÂç¹ýÔØ¡£Èç¹ûÄãÒѾ­Óþ¡Ò»Çд«Í³·½·¨³¢ÊÔ»º½â Docker Æô¶¯ÑÓ³Ù£¬ÄÇô Kraken ¿ÉÄÜ»áΪÄã´øÀ´ÐµÄÏ£Íû¡£

Anaconda

Anaconda Distribution ÊÇÒ»Ì×¾­¹ý¾«ÐÄÉè¼ÆÇÒÍêÈ«¿ªÔ´µÄ Python£¨Óë R£©Èí¼þ°ü¼¯ºÏ£¬×¨ÃÅÃæÏò¸÷Àà»úÆ÷ѧϰÓëÊý¾Ý¿ÆѧÐèÇó¡£Anaconda ÓëÆäËû·¢ÐаæÖ®¼ä×î´óµÄÇø±ð£¬ÔÚÓÚ Anaconda Navigator£¨ÓÃÓÚÆô¶¯Ó¦ÓóÌÐòÓë¹ÜÀíÈí¼þ°üµÄͼÐλ¯×ÀÃæ»·¾³£©ÒÔ¼° Anaconda µÄ±¾µØÈí¼þ°ü¹ÜÀíÆ÷ Conda¡£

ÓÉÓÚ´ó¶àÊýÈí¼þ°ü¶¼°üº¬Õë¶ÔÌض¨°æ±¾µÄÒÀÀµÐÔ£¬Òò´ËÈç¹ûûÓÐ Conda µÄ°ïÖú£¬ÎÒÃǽ«ºÜÄѱÜÃâÆä°²×°³åÍ»²¢±£Ö¤ËùÓÐÈí¼þ°üµÄ¼°Ê±¸üС£Conda ¸ºÔð¹ÜÀí Anaconda ¹«¿ª¿âÒÔ¼°µÚÈý·½ÇþµÀµ±ÖÐËùÓеÄÒÀÀµ¹ØϵÓë¸üС£Pip Ϊ Pythonr Ô­ÉúÈí¼þ°ü¹ÜÀíÆ÷£¬ÓµÓÐÇ¿´óµÄ Python Èí¼þ°ü°²×°Óë¹ÜÀíÄÜÁ¦£»µ« Conda ²»½öÄܹ»´¦Àí Python Èí¼þ°ü£¬Í¬Ê±Ò²Äܹ»³Ðµ£Æð Python Éú̬ϵͳ֮ÍâµÄ¸÷ÀàÒÀÀµ¹Øϵ¹ÜÀí¹¤×÷¡£

Anaconda ½ñÄêΪ Conda ´øÀ´ÁËÓû§ÃÇÆÚ´ýÒѾõÄÐÔÄÜÌáÉý¡£ÓÉÓÚÆäÖа²×°´óÁ¿¿â£¬Òò´ËÆä¸üеÄÏÂÔØÓë°²×°±äµÃÒì³£»ºÂý¡£ÐÒÔ˵ÄÊÇ£¬×Ô Conda 4.7 ÓÚ½ñÄêÏļ¾·¢²¼ÒÔÀ´£¬ÎÒÃÇ·¢ÏÖÈí¼þ°üµÄ¹ÜÀíÌåÑé±äµÃ¸üÇá¡¢¸ü¿ì¡£

×÷ΪÊÊÓÃÓÚ Linux¡¢Windows ÒÔ¼° MacOS µÄȫƽ̨ÏîÄ¿£¬Anaconda Distribution ÎÞÒÉÊÇÒ»Ì×Ò»Á÷µÄ»úÆ÷ѧϰÓëÊý¾Ý¿ÆѧÉú̬ϵͳ£¬Ö§³Ö GPU ѵÁ·²¢Ìṩǿ´óµÄ×÷Òµµ÷¶È³ÌÐò¡£ÁíÍ⣬×ñÑ­ BSD Ðí¿ÉÒ²ÈøÃÏîÄ¿¶ÔÓÚ¿ª·¢ÈËÔ±ÓµÓÐ׿«´óµÄÎüÒýÁ¦¡£

Kotlin

ºÅ³ÆΪ¡°ÍêÃÀ°æ Java¡±µÄ Kotlin ÓïÑÔÓÉ JetBrans ¹«Ë¾Ëù´´½¨¡£¸Ã¹«Ë¾»¹¿ª·¢³öÕë¶Ô Java µÄ IntelliJ ID¡£Kotlin ÓïÑ﵀ beta °æ±¾×î³õ·¢²¼ÓÚ 2011 Ä꣬ËüÄܹ»Ïñ Java Ò»ÑùÔÚ JVM ÉÏÔËÐУ¬²¢Äܹ»Óë Java ¿âÎÞ·ìʵÏÖ»¥²Ù×÷¡£µ«ÊÇ£¬ËüÒ²Ïû³ýÁË Java µ±ÖеĴóÁ¿ÈßÓàϸ½Ú£¬Ôö¼ÓÁËÇ¿´óµÄº¯Êý±à³ÌÄÜÁ¦£¬Í¬Ê±ÒÔ¸üÓÅÑŵķ½Ê½½â¾öÁË¿ÕÖ¸ÕëÒì³£µÈ°²È«ÎÊÌâ¡£´ËÍ⣬¹È¸èÄ¿Ç°Ò²ÒѾ­½« Kotlin Ö¸¶¨Îª´´½¨ Android Ó¦ÓóÌÐòµÄÊ×Ñ¡ÓïÑÔ£¬ÕâÒâζ׿´Ê¹×ªÍ¶ Kotlin »³±§£¬¸÷λ Java ¿ª·¢ÕßÒ²²»Óõ£ÐÄʧȥ Android ÕâÒ»¾Þ´óµÄÓ¦Óÿª·¢Êг¡¡£

Kotlin µÄÒ»´ó»ù±¾·¢Õ¹·½Õ룬ÔÚÓÚÖ»²ÉÓò¿·Ö Java ʵÏÖ˼·²¢½«Æä×÷ΪÓïÑÔÓ빤¾ßÁ´ÖеÄÖ÷Òª²¿·Ö¡£Kotlin 1.3 °æ±¾ÓÚ 2018 ÄêÄ©·¢²¼£¬Ôö¼ÓÁËÖ±½Ó½« Kotlin ±àÒëΪƽ̨±¾»ú´úÂëµÄ¹¦ÄÜ¡ª¡ªÕâÒ²½â¾öÁ˳¤ÆÚÒÔÀ´ Java һֱδÄÜʵÏÖµÄÖØ´óÄÑÌ⣨ֻÄÜͨ¹ýÉÌÒµ²å¼þʵÏÖ£©¡£ÁíÒ»ÏîÓëÖ®Ïà¹ØµÄ¹¦ÄÜΪ contracts£¬ÕâÊÇÒ»ÖÖÀûÓú¯Êý¶Ô±àÒëÆ÷¹¤×÷·½Ê½½øÐÐÃèÊöµÄ·½·¨¡£ÏÖÔÚ£¬Kotlin ±ê×¼¿âÖеÄËùÓк¯Êý¶¼ÒѾ­Ê¹Óõ½ contracts¡£Kotlin ÏîÄ¿µÄ³¤Æڼƻ®²»ÔÙÊÇ¿Ë¡ Java£¬¶øÊÇÈ«ÃæʵÏÖ³¬Ô½¡£

Julia

Ëæ×ÅÊý¾Ý¿ÆѧµÄÍ»·ÉÃͽø£¬Êг¡¶Ô¿ìËÙ±ã½ÝÊýÖµ¼ÆË㹤¾ßµÄÐèÇóÒ²ÔÚ²»¶ÏÔö³¤¡£Julia ÓïÑÔÕýÊÇΪ´ËÉè¼Æ¶ø³É£¬Ö¼ÔÚ´øÀ´Óë Python Ï൱µÄ±ã½ÝÐÔ¡¢Óë C Ï൱µÄËٶȱíÏÖÒÔ¼°Óë Fortran¡¢R ÄËÖÁ Matlab Ï൱µÄÓѺÃÉÏÊÖ¸ÐÊÜ¡£½á¹û¾ÍÊÇ£¬Õâ¿î±à³ÌÓïÑÔѸËÙÎüÒýµ½¸÷ÀàÊýѧÒÔ¼°Í³¼ÆѧÓû§µÄ¹Ø×¢¡ª¡ª°üÀ¨Êý¾Ý¿Æѧ¼Ò¡¢Ñо¿¿Æѧ¼Ò¡¢¹¤³ÌʦÒÔ¼°½ðÈÚ·ÖÎöʦÓëÁ¿»¯×¨¼Ò¡£

¾­¹ý¾ÅÄêµÄ¿ª·¢ÓëÆßÄêµÄ beta ²âÊԽ׶Σ¬Julia 1.0 ÓÚ 2018 ÄêÕýʽÁÁÏà¡£ÕâÒ»Àï³Ì±®°æ±¾ÕûºÏÁ˺ËÐŦÄÜÓë»úÆ÷ÂëÔ­ÉúËٶȱíÏÖ¡¢ÊýѧÓѺÃÐÍÓï·¨¡¢¶à´Î·ÖÅÉ¡¢Òì²½ I/O¡¢²¢ÐÐÐÔ¡¢Èí¼þ°ü¹ÜÀíÒÔ¼°Á¼ºÃµÄÓïÑÔÕûÌåÎȶ¨ÐÔµÈÓÅÊÆ¡£×ÔÄÇʱÒÔÀ´£¬Julia µÄÈý´óÖ÷Òª·¢Ðаæ´øÀ´ÁËÊýÊ®Ïîй¦ÄÜ£¬Ö¼ÔÚ²»¶Ï¸ÄÉÆÆäÊýѧ¡¢Í³¼ÆÒÔ¼°³£¹æ±à³Ì·½ÃæµÄʵ¼Ê±íÏÖ¡£

Hazelcast Jet

½ñÄ꣬ÒÔ¿ªÔ´ÄÚ´æÊý¾ÝÍø¸ñÎÅÃûµÄ Hazelcast ·¢²¼ÁË Hazelcast Jet µÄÊ׸öͨÓð汾¡£Hazelcast Jet ÊÇÒ»Ì× Java ¿ÉǶÈë·Ö²¼Ê½Á÷´¦ÀíÒýÇæ¡£¾¡¹Ü¸Õ¸Õ·¢²¼Í¨Óð汾£¬µ« Hazelcast Jet 3 ÒѾ­ÓµÓжàÄêµÄʵ¼ùÓ¦Óþ­Ñ飬²¢ÓÃʵ¼Ê±íÏÖÖ¤Ã÷ÁËÆäÇ¿´óµÄ¿É¿¿ÐÔˮƽ¡££¨´Ó 3.x °æ±¾¿ªÊ¼£¬Jet Óë Hazelcast µÄÆì½¢ IMDG ²úÆ·°æ±¾±£³ÖÒ»Ö¡££©

ÔÚºǫ́£¬Hazelcast Jet ²ÉÓà java.util.stream API ´´½¨³öÒ»Ì׶àÏß³ÌÊý¾ÝÉãÈ¡ÍøÂ磬¸ÃÍøÂçÄܹ»ÔÚµ÷ƵÇé¿öϸßЧÔËÐС£´ËÍ⣬Á¬½ÓÆ÷Ñ¡ÏîʹÓû§Äܹ»ÇáËÉÀûÓà Hazelcast IMDG¡¢HDFS ÒÔ¼° Kafka µÈÊý¾ÝÔ´½øÒ»²½·á¸»Êý¾ÝÁ÷¡£¶ÔÓÚʵʱ±ßÔµÓ¦ÓóÌÐò£¨ÀýÈç¶ÔÎïÁªÍø´«¸ÐÆ÷ÍøÂçµÄ¼à¿ØÒÔ¼°ÃæÏòÖ§¸¶´¦ÀíÍøÂçµÄÆÛÕ©¼ì²â£©£¬Jet ÒѾ­³ÉΪһÌ×ÀíÏëµÄ½â¾ö·½°¸¡£

Hazelcast Jet µÄͨÓð汾Ìṩ¶Ô Java 11 µÄÈ«ÃæÖ§³Ö£¬´Ó¶øÔöÇ¿¶ÔÊý¾ÝÁ÷Õï¶ÏµÄ·ÖÎöÄÜÁ¦¡¢ÐµĹÜÀíת»»Óë¾ÛºÏ¹¦ÄÜÒÔ¼°ÎÞËð×÷Òµ»Ö¸´£¨½öÊÊÓÃÓÚÆóÒµ°æ£©¡£Java ¿ª·¢ÈËÔ±¿ÉÒÔÔÚÕâÀïʹÓõ½×Ô¼ºÊìϤµÄ map¡¢filter ÒÔ¼° reduce µÈ¸ÅÄî¡£Èç¹û´ó¼ÒÏ£Íû½«·Ö²¼Ê½ÊµÊ±Ç鱨ǶÈëÖÁÁ÷´¦Àí Java Ó¦ÓóÌÐòµ±ÖУ¬ÄÇô Hazelcast Jet ¾ø¶ÔÖµµÃÒ»ÊÔ¡£

Apache Airflow

Apache Airflow ÊÇÒ»Ì×»ùÓÚ Python µÄƽ̨£¬¸ºÔðÒԿɱà³Ì·½Ê½ÊµÏÖ¹¤×÷Á÷µÄ±àд¡¢¹æ»®Óë¼à¿Ø¡£ÕâЩ¹¤×÷Á÷ÊôÓÚÈÎÎñµÄÓÐÏòÎÞ»·Í¼£¨DAG£©£¬´ó¼Ò¿ÉÒÔÀûÓà Python ´úÂë±àдÁ÷Ë®ÏßÒÔʵÏÖ DAG ÅäÖá£

Airflow Äܹ»Éú³É Web ·þÎñÆ÷³äµ±ÆäÓû§½çÃæ¡£ÎÒÃÇ¿ÉÒÔͨ¹ý¸ÃÍøÕ¾²é¿´¶àÖÖÊÓͼÒÔ¹Û²ì DAG£¬²¢½è´Ë¶Ô DAG ½øÐвÙ×÷¡£´ËÍ⣬Airflow »¹ÌṩÃüÁîÐнçÃ棬¸Ã½çÃæͬÑùÔÊÐíÓû§¶Ô DAG ½øÐжàÖÖÀàÐ͵IJÙ×÷£¬Í¬Ê±ÊµÏÖ·þÎñÆô¶¯¡¢¿ª·¢Óë²âÊÔ¡£

´ó¼Ò¿ÉÒÔ×ÔÖ÷¶¨Òå²Ù×÷³ÌÐòÓëÖ´ÐгÌÐò£¬Í¬Ê±À©Õ¹ Airflow ¿âÒÔÈ·±£ÆäÓëÄãµÄ»·¾³³éÏ󼶱ðÏàÆ¥Åä¡£Äã¿ÉÒÔʹÓà Jinja Ä£°åÒýÇæ¶Ô½Å±¾½øÐвÎÊý»¯¡£Airflow »¹¾ßÓпÉÀ©Õ¹µÄÄ£¿é»¯¼Ü¹¹£¬²¢Ê¹ÓÃÏûÏ¢¶ÓÁÐÒÔ°²ÅÅÈÎÒâÊýÁ¿µÄ¹¤×÷³ÌÐò¡£Airflow ÒÔÊý¾Ý¿âΪ»ù´¡£¬Äã¿ÉÒÔÑ¡ÔñʹÓà SQLite£¨½öÓÃÓÚ¿ª·¢¼°²âÊÔ£©»òÕßÈκÎÆäËû³£¼ûµÄ¹ØϵÊý¾Ý¿âÑ¡Ïî¡£

GridGain

´óÔ¼ÎåÄê֮ǰ£¬GridGain ½« Ignite ´úÂë¿â½»ÓÉ Apache Èí¼þ»ù½ð»á½øÐпªÔ´¡£×ÔÄÇʱÒÔÀ´£¬¸Ã¹«Ë¾Ò»Ö±ÔÚΪÕâÌ×ÄÚ´æÊý¾ÝÍø¸ñƽ̨ÌṩÆóÒµ¼¶¹¦ÄÜ¡¢¸üÐÂÓ빦ÄÜÔöÇ¿¡£GridGain ÉçÇø°æ ÓÚ½ñÄê 3 ÔÂÊ×´ÎÁÁÏ࣬ÆäÏà½Ï Apache Ignite ²ÉÓÃÁËÏàͬµÄÇ©Ãû GridGain µ÷ÕûÓë²¹¶¡ÒÔʵÏÖÐÔÄÜÓë¿É¿¿ÐÔÓÅ»¯£¬Í¬Ê±ÔöÇ¿ÁË°²È«ÐÔ²¢¼ò»¯¹Ø¼üÈÎÎñ²¿ÊðµÄά»¤Á÷³Ì¡£

GridGain ÉçÇø°æÌṩ¿ÉÉìËõ¼¯Èº¡¢±¾»ú¸´ÖÆÒÔ¼°Á¼ºÃµÄ±¸·ÝÓë»Ö¸´Ñ¡ÏÒò´Ë·Ç³£ÊʺÏÁ¢×ã·Ö²¼Ê½Êý¾ÝÖÐÐÄΪÊý¾ÝÃܼ¯ÐÍÓ¦ÓóÌÐòÌṩ·þÎñ¡£´ËÍ⣬GridGain »¹Ö§³Ö±¾µØ¡¢ÔÆÒÔ¼°»ìºÏ²¿Êð·½Ê½¡£ËäÈ» GridGain Öеĸ߼¶¹¦Äܼ¯ÈÔȻҪÇó°´Ð踶·Ñ£¬µ«Æ¾½è×Å´Ë´ÎÍƳöµÄ GridGain ÉçÇø°æ£¬´ó¼ÒÍêÈ«¿ÉÒÔÃâ·ÑÏÂÔØÕâÌ׿ɿ¿µÄ¸ßÈÝÁ¿¡¢ÄÚ´æÄÚÁ÷ʽ´«ÊäÓëʵʱʼþ´¦Àíƽ̨¡£

Apache Druid

Apache Druid ÊÇÒ»Ì×ÃæÏòÁеÄʱ¼äÐòÁÐÊý¾Ý¿â¼Ó·ÖÎöÒýÇ棬¿ÉΪʼþÇý¶¯Ð͸ßËÙÊý¾Ý´øÀ´ÊµÊ±¿ÉÊÓ»¯ÓëµÍÑÓ³Ù²éѯ¹¦ÄÜ¡£Druid ½«Á÷ʽÉãÈ¡¡¢OLAP ·ç¸ñµÄÅúÁ¿ÉãÈ¡ÒÔ¼°ËÑË÷¼¼Êõ½áºÏÔÚÒ»Æð£¬Äܹ»ÇáËɶÔʵʱ¼°ÀúÊ·Êý¾Ý½øÐÐÇÐƬ¡¢ÇпéÒÔ¼°×ª»»¡£³öÉ«µÄ¿ÉÉìËõÐÔÒÔ¼°ÉÁµç°ãµÄ¼´Ê±²éѯÏìÓ¦Ëٶȣ¬Ê¹µÃ Druid ³ÉΪ³¬Ô½´«Í³Êý¾Ý²Ö¿âµÄ¸üÇ¿½»»¥Ê½Ó¦ÓóÌÐòÓë¸ß²¢·¢¹¤×÷¸ºÔØ´¦ÀíÑ¡Ïî¡£

Druid ÊǸö¹æÄ£Ïà¿É¹ÛµÄ¿ªÔ´ÏîÄ¿¡£¼¯Èºµ±Öаüº¬¶à¸ö·þÎñÆ÷Óë½ø³Ì£¬¸ºÔð¸÷×Ô¶ÀÁ¢µØ´¦ÀíÉãÈ¡¡¢²éѯ»òÕß¹¤×÷¸ºÔØЭµ÷ÈÎÎñ¡£µ«ÊÇ£¬ÕâÖÖ¸´ÔÓÐÔ²¢Ã»ÓÐÓ°Ïìµ½³öÉ«µÄÁé»îÐÔÓë¿É¿¿ÐÔ¡£¾¡¹ÜÄ¿Ç° Druid Éд¦ÓÚ Apache ·õ»¯½×¶Î£¬µ«ÆäÒѾ­ÓµÓÐÁ¼ºÃµÄÎȶ¨ÐÔ¡¢ÈÝ´íÄÜÁ¦²¢Äܹ»ÔÚ±¾µØ»òÕßÔÆ»·¾³ÖÐÖ§³ÖÉú²úÁ÷³Ì¡£

Èç¹ûÄãÐèÒª¸ü¸ß¼¶µÄ Druid ¹¤¾ß£¬ÎÒ½¨Òé´ó¼ÒÊÔ Imply ·¢Ðа棬ÕâÌ×·¢ÐаæÌí¼ÓÁËÍÏקʽ GUI¡¢¸ß¼¶·ÖÎöÒÔ¼°Ïòµ¼Çý¶¯ÐÍ Kafka ¼¯³É»úÖÆ£¬Íâ¼ÓÆäËû¶àÖÖ¼à¿ØÓë¹ÜÀí¹¦ÄÜ¡£ÎªÁËʹ´óÁ¿Ê¼þÔ´ÓëÏÂÓηÖÎö¸ü¿É¿¿µØñîºÏÆðÀ´£¬ÕâÀïÒ²½¨ÒéÄ㿼Âǽ« Apache Kafka Ìí¼Óµ½×éºÏµ±ÖС£ÔÚÕâÀÎÒÃÇÍƼö Confluent ·¢Ðа档Kafka Óë Druid Õâ¶Ô×éºÏ½«³ÉΪһ¶ÔÇ¿´óµÄʼþÇý¶¯ÐÍʵʱ·ÖÎö´îµµ¡£

TensorFlow

ÔÚÄ¿Ç°ÊÐÃæÉÏËùÓпÉÓõijöÉ«»úÆ÷ѧϰÓëÉî¶Èѧϰ¿ò¼Üµ±ÖУ¬TensorFlow ÎÞÒÉÊÇ×î³ÉÊì¡¢ÔÚÑо¿ÂÛÎÄÖÐÒýÓôÎÊý×î¶à£¨¼´Ê¹Åųýµô¹È¸èÔ±¹¤µÄÒýÓÃÒ²ÊÇÈç´Ë£©¡¢¶øÇÒÔÚʵ¼ÊÉú²úÖбíÏÖ×îÁÁÑÛµÄÑ¡Ïî¡£ËäÈ»ËüµÄѧϰÇúÏ߱Ƚ϶¸ÇÍ£¬µ«ÈëÃÅÄѶÈÒѾ­Ô¶µÍÓÚ 2016 ÄêµÄ°æ±¾¡£ÁíÍ⣬TensorFlow Ò²ÒѾ­³ÉΪÖÚ¶à¹È¸è·þÎñµÄʵÏÖ»ù´¡¡£

TensorFlow 2.0 רעÓÚ¼òµ¥»¯ÓëÒ×ÓÃÐÔ£¬²¢Ó­À´Á˼±ÇÐÖ´ÐС¢Ö±¹Û¸ß¼¶ API£¨Keras£©ÒÔ¼°Á¢×ãÈÎÒâƽ̨ʵÏÖÁé»î½¨Ä£µÈÖØÒª¸üС£¼±ÇÐÖ´ÐÐÒâζ×Å TensorFlow ´úÂëÄܹ»ÔÚ¶¨ÒåʱÁ¢¼´ÔËÐУ¬¶ø²»±ØµÈ´ý½«ËùÓнڵ㼰±ß½çÌí¼Óµ½ÔËÐлỰµ±ÖУ¨ºóÒ»ÖÖÕýÊÇ TensorFlow µÄԭʼÔËÐÐģʽ£©¡£TensorFlow 2.0 Ò²¼ÌÐøÖ§³Ö TensorBoard ͼÐλ¯ÓëÕï¶Ï¹¦ÄÜ¡£

TensorWatch

¾¡¹Ü TensorBoard ³É¹¦½µµÍÁË TensorFlow ÒÔ¼°ÐÂÐÍ PyTorch ³ÌÐòµÄÀí½â¡¢µ÷ÊÔÓëÓÅ»¯Ãż÷£¬µ«ÆäÈÔÓÐÒ»´óÖÂÃüȱµã¡ª¡ªÐèÒªÔÚѵÁ·Íê³ÉºóÁ¢×ãÈÕÖ¾ÎļþÔËÐв¢Ê¹ÓÃ×Ô¼ºµÄ¶ÀÁ¢Óû§½çÃæ¡£ÊÂʵÉÏ£¬TensorBoard µÄÈÕÖ¾¼Ç¼·ÖÎö»á´øÀ´¾Þ´óµÄ×ÊÔ´¿ªÏú¡£

TensorWatch ?ÊÇÒ»Ì×ÓÃÓÚÉî¶ÈѧϰģÐ͵÷ÊÔÓë¿ÉÊÓ»¯µÄ Python ¿â£¬ÓÉ΢ÈíÑо¿Ôº¿ª·¢Íê³É¡£ÆäÄܹ»ÔÚÄ£ÐÍѵÁ·µÄͬʱ£¬ÊµÊ±ÏÔʾ¿ÉÊÓ»¯Í¼ÐΡ£´ËÍ⣬Ëü»¹Ìṩǿ´óµÄѵÁ·Ç°ÓëѵÁ·ºó¹¦ÄÜ£¬°üÀ¨Ä£ÐÍͼ¿ÉÊÓ»¯¡¢½µÎ¬Êý¾Ý̽Ë÷¡¢Ä£ÐÍͳ¼ÆÒÔ¼°ÓÃÓÚ¾í»ýÍøÂçµÄ¶àÖÖÔ¤²â½âÊÍÆ÷¡£

TensorWatch ¿ÉÀûÓà Jupyter Notebooks »òÕß Jupyter Lab Ìṩ½»»¥Ê½ÊµÊ±ÑµÁ·Á÷³Ìµ÷ÊÔ¹¦ÄÜ¡£³ýÁË TensorBoard ʹÓõÄÖ±½ÓÈÕÖ¾¼Ç¼ģʽ֮Í⣬TensorWatch »¹Ö§³ÖÀÁ¶èÈÕÖ¾¼Ç¼ģʽ£¬¸ºÔðÒÔ¼«µÍµÄ×ÊÔ´¿ªÏú¹Û²ì±äÁ¿¡£ÔÚ´ËÖ®ºó£¬´ó¼Ò¿ÉÒÔÁ¢×ã±äÁ¿ÉÏÏÂÎÄÖ´Ðн»»¥Ê½²éѯ£¬²¢·µ»ØÏà¹ØÊý¾ÝÁ÷¹©½øÒ»²½¿ÉÊÓ»¯´¦Àí¡£

PyTorch

ÔÚ 2018 ÄêÈëפÉî¶ÈѧϰÁìÓò²¢Á¢¼´³ÉΪÑо¿ÈËÔ±µÄÈÈÃÅÑ¡ÏîÖ®ºó£¬PyTorch ÔÚ 2019 Äê½øÒ»²½Õë¶ÔÉú²úÐèÇó×ö³öÁ˸Ľø¡£Ëæ×Å PyTorch 1.0 °æ±¾µÄµ½À´ÒÔ¼° TorchScript µÄ³öÏÖ£¨TorchScript Ϊ JIT ±àÒëµÄ Python ×Ó¼¯£¬Í¬Ê±ÅäºÏÒ»Ì׸ßËÙ C++ ÔËÐÐʱ£©£¬¸Ã¿ò¼ÜÎÞÒÉÒѾ­ÎªÉú²úÓ¦ÓÃ×öºÃ×¼±¸¡£¼ÈÈ» Facebook ¹«Ë¾Äܹ»ÀûÓà PyTorch ¸ã¶¨Ã¿ÌìÒ»ÍòÒڴβÙ×÷£¬ÄÇôËüÒ²¾ø¶ÔÄܹ»Âú×ãÎÒÃǵÄËùÓÐÈÕ³£ÐèÇó¡£

³ýÁËÉú²ú¾ÍÐ÷Ö®Í⣬¹ýÈ¥Ò»Äêµ±ÖУ¬PyTorch µÄÏà¹ØÉú̬ϵͳҲ¿ìËÙ·¢Õ¹³ÉÊì¡£Èç½ñ£¬ËüÓÐÁË×Ô¼ºµÄÖÐÊàƽ̨ PyTorch Hub£¬ÓÃÓÚ´æ´¢¸÷Àྭ¹ýÔ¤ÏÈѵÁ·µÄ PyTorch Ä£ÐÍ£¬Íâ¼ÓÏà¹ØÎı¾¡¢ÊÓ¾õÓëÒôƵ¿â¡£ÕâЩ¿â°üº¬×îÏȽøµÄ¼¼Êõ³É¹û£¬¶øÇÒÈ«²¿´ò°ü¾ÍÐ÷¹©Óû§Ö±½ÓʹÓ᣺ÁÎÞÒÉÎÊ£¬PyTorch ÒѾ­³ÉΪÖÚ¶àÊý¾Ý¿Æѧ¼ÒµÄ×î°®£¬²¢ÓÐÍûÔÚ 2020 ÄêÄËÖÁÖ®ºóÒÔ¸üµÍµÄÉÏÊÖÃż÷ÔÚÉî¶ÈѧϰÁìÓò·¢»ÓÖØ´ó×÷Óá£

PyTorch-Transformers

Hugging Face µÄ¿ª·¢ÈËÔ±ÃÇͨ¹ý PyTorch-Transformers Ϊ PyTorch ÒÔ¼° NLP£¨×ÔÈ»ÓïÑÔ´¦Àí£©ÉçÇø×ö³öÁ˾޴óµÄ¹±Ïס£ÕâÌ׿âÖаüº¬×Å´óÁ¿×îС¢×îÇ°ÑØµÄ NLP Ñо¿Ä£ÐÍʵÏֳɹû£¬ÀýÈç BERT¡¢GPT-2 ÒÔ¼° XLNet µÈµÈ¡£ÕâЩʵÏÖͨ³£»áÔÚÒ»ÖÜÖ®ÄÚ½øÐиüУ¬ÓÃÒÔ¼°Ê±¸ú½øеÄÄ£ÐÍ»ò°æ±¾¡£

ƾ½è×ÅÃæÏòÈ«²¿Ä£Ð͵Äͳһ API ÒÔ¼°Õë¶ÔÒÑѵÁ·Ä£ÐÍ£¨Í¬Ê±Ö§³Ö¶Ô TensorFlow ѵÁ·Ä£ÐͽøÐÐת»»£©¼°ÐÂÄ£Ð͹¹½¨µÄÍêÉÆÎĵµ£¬PyTorch-Transformers ÎÞÒɳÉΪ¼±ÇÐÏ£Íû̽Ë÷½¨Ä£ÐÂÊÀ½çµÄÅóÓÑÃǵÄ×î¼ÑÑ¡Ôñ¡£ÔÚѧÊõÑо¿Ö®Í⣬ÕâÌ׿âÒ²¾ß±¸³ä·ÖµÄʵÓÃÐÔ£¬¿ÉÓÃÓÚ Hugging Face ×Ô¼ÒµÄ Talk To Transformer µÈ²úÆ·µ±ÖС£

Ludwig

Ludwig ÊÇÒ»Ì×ÓÉ Uber ¹«Ë¾¿ª·¢µÄ Python ¹¤¾ßÏ䣬»ùÓÚ TensorFlow£¬Ö¼ÔÚ½µµÍÉñ¾­ÍøÂç±à³ÌµÄ¸´ÔÓÐÔˮƽ¡£Ludwig Äܹ»°ïÖúÊý¾Ý¿ÆѧÐÂÊÖÔÚÎÞÐè±àдÈκδúÂëµÄÇ°ÌáÏ£¬Íê³É¶Ô¸´ÔÓÉî¶ÈѧϰģÐ͵ÄѵÁ·Óë²âÊÔ¡£Ã»´í£¬Ö»ÐèÒª¶Ô YAML ÅäÖÃÉùÃ÷Îļþ½øÐвÎÊýµ÷Õû£¬¼´¿ÉÇáËÉÍê³ÉÄ¿±ê¡£µ±È»£¬¾­Ñé¸üΪ·á¸»µÄÊý¾Ý¹¤³ÌʦҲ¿ÉÒÔÔÚºǫ́µ÷Õû¸ü¶àÆäËû²ÎÊý¡£

Ludwig ÔÊÐí´ó¼Ò¶¨ÒåÊý¾ÝÔ´£¨Ä¿Ç°Ö§³Ö CSV Îļþ»òÕß Pandas DataFrame£©£¬Í¬Ê±Ñ¡ÔñÄãÐèÒªµÄ¹¦ÄÜÓë±àÂëÆ÷¡£½ÓÏÂÀ´£¬Ludwig »áÔ¤´¦ÀíÆ÷¿ªÊ¼¹¤×÷£¬Í¨¹ý²ð·ÖÊý¾Ý¼¯½øѵÁ·Óë²âÊÔ¡¢¹¹½¨Éñ¾­ÍøÂ磬²¢Í¨¹ý²»Í¬µÄÄ£ÐÍÓÅ»¯·½·¨½øÐеü´ú¡£ÄÚÖõĿÉÊÓ»¯¹¤¾ßÔÊÐíÓû§¼ì²éÄ£Ð͵IJâÊÔÐÔÄÜÓëÔ¤²âÖµ½á¹û¡£´ËÍ⣬Ludwig ÌṩµÄ±à³Ì API »¹Äܹ»Ö±½Óµ¼Èë Python µ±ÖУ¬ÕâҲʹµÃ¸Ã¹¤¾ß°üµÄʵÓÃÐÔÔ¶Ô¶³¬Ô½ÁË´¿ÃüÁîÐз¶³ë¡£

Ludwig Ö§³Ö´óÁ¿Êý¾ÝÀàÐÍ£¨´ÓÎı¾µ½Í¼Ïñ£¬ÔÙµ½Ê±¼äÐòÁУ©ÒÔ¼°¶àÖÖÉñ¾­ÍøÂç±àÂëÆ÷£¨°üÀ¨¶àÖÖ CNN/RNN ×éºÏ£¬ÒÔ¼°ÓÃÓڽϴóͼÏñ´¦ÀíÍøÂçµÄ ResNet£©¡£Ludwig ÓëÆäËû Uber ¹¤¾ß£¨°üÀ¨ÓÃÓÚ·Ö²¼Ê½ GPU ѵÁ·µÄ Horovod£©ÅäºÏÁ¼ºÃ£¬²¢½«ºÜ¿ìÔö¼Ó¶Ô Amazon S3 ÒÔ¼° HDFS ´æ´¢µÄÖ§³ÖÄÜÁ¦¡£

Èç¹û´ó¼ÒÏ£ÍûÔÚÉî¶ÈѧϰÁìÓò»ñµÃ¸ü¿ìµÄµü´úʵÑéÄÜÁ¦£¬ÄÇô Ludwig µÄʵ¼Ê±íÏÖÓ¦¸ÃÄܹ»Âú×ãÄãµÄÐèÇó¡£

RAPIDS

Ò»°ãÀ´Ëµ£¬ÌáÉýËÙ¶ÈÒ²¾ÍÒâζ×Å·ÅÆú¾ÉÓз½·¨¡ª¡ªÖ»ÓаÚÍÑÄãËùÊìϤµÄ¹ÌÓнâ¾ö·½°¸£¬²ÅÄÜÒÔÒ»ÖÖÍêÈ«²»Í¬µÄ;¾¶ÊµÏÖËÙ¶ÈÌáÉý¡£µ« RAPIDS ÖÂÁ¦ÓÚ´òÆÆÕâÖÖ¾ÖÃ棬ÕâÊÇÒ»Ì×Êý¾Ý¿Æѧ¿ò¼Ü£¬Äܹ»ÔÚÎÞÐè·ÅÆúÒÑÓÐ֪ʶÓë¼¼ÄܵÄÇ°Ìáϳɹ¦ÊµÏÖ»úÆ÷ѧϰ¼ÓËÙ¡£

RAPIDS Äܹ»ÀûÓÃÄÚ´æÄÚ´¦Àí·½Ê½ÔÚ GPU ÉÏÖ±½ÓѵÁ·»úÆ÷ѧϰģÐÍ£¬¶øÇÒ¼´Ê¹ÓëÆäËû GPU ѵÁ··½·¨Ïà±È£¬ÆäѵÁ·ËÙ¶ÈˮƽÈÔȻҪ¸ß³ö¼¸¸öÁ¿¼¶¡£ËüËùʹÓõÄÊý¾Ý·ÖÎö¹¤¾ßÓë Python Ïà¹ØʵÏÖ·½°¸ÍêÈ«µÈЧ£¨Ö÷ÒªÊÇ Pandas DataFrames£©µ«ÓÖÓÐËù²»Í¬£¬ÔÚijЩÇé¿öÏÂÄãÖ»ÐèÒª±ä¸ü½Å±¾ÖÐµÄ import Óï¾ä¼´¿ÉÍê³É¼æÈÝ¡£

RAPIDS Ä¿Ç°µÄÒ»´óÖÂÃüȱÏÝÔÚÓÚƽ̨֧³ÖÄÜÁ¦ÓÐÏÞ¡£¸Ã¿ò¼ÜÄ¿Ç°½öÄܹ»ÔËÐÐÔÚ Ubuntu Óë CentOS ϵͳ֮ÉÏ£¬¶øÇÒÐèÒªÓë Python µÄ Anaconda ·¢ÐаæÅäºÏ²ÅÄÜʵÏÖ×î¼ÑЧ¹û¡£ÁíÍ⣬ËüÒ²²»¾ß±¸Í¨¹ý pip ÔÚͨÓà Python »·¾³Ï½øÐа²×°µÄ¹¦ÄÜ¡£µ«ÊÇ£¬Æ¾½è׎«Êý¾Ý×¼±¸ÓëÄ£ÐÍѵÁ·ÈÎÎñǨÒÆÖÁ GPU£¬ËüȷʵÄܹ»°ïÖú´ó¼ÒÏÔÖø½ÚԼʱ¼ä£¬Õâ¿ÉÒÔÔÚÏ൱³Ì¶ÈÉϵÖÏûÒÔÉÏÖÖÖÖ²»±ã¡£

MLflow

»úÆ÷ѧϰÏîÄ¿ÓµÓÐ×Ô¼ºµÄÒ»Ì×ÉúÃüÖÜÆÚ¡£¾ßÌåÀ´½²£¬ÊµÑé¹ý³ÌÄÑÒÔ¸ú×Ù¡¢Ä£ÐÍÄÑÒÔÍƹ㡢½á¹ûÒ²ÄÑÒÔÖØÏÖ¡£MLflow ÏîÄ¿µÄ½¨Á¢Ä¿±êÔÚÓÚÈûúÆ÷ѧϰÏîÄ¿ÓµÓÐÓëÆäËûÈí¼þ¿ª·¢ÏîÄ¿ÀàËƵĵ͹ÜÀíÃż÷£¬Í¬Ê±ÌṩһÖÂÇÒ¿ÉÖظ´µÄ·½Ê½ÒÔʵÏÖÊý¾Ý×¼±¸¡¢´úÂëÓëÅäÖøú×Ù¼°Êä³ö¡¢Ä£ÐÍÓ빤×÷Á÷¹²ÏíÒÔ¼°Éú²ú»·¾³ÏµÄÄ£ÐͲ¿Êð¡£

MLflow Ϊ»úÆ÷ѧϰÏîÄ¿Öеĸ÷¸öÖ÷Òª×é³É²¿·Ö¼°½×¶Î¶¼×¼±¸Á˶ÔÓ¦µÄ¹¤¾ß¡£ÔÚ»úÆ÷ѧϰʵÑé·½Ã棬MLflow Ìṩ API ÒÔʵÏÖ½á¹ûµÄ¸ú×ÙÓë±È½Ï¡£ÎªÁËÖØÏÖÓÃÓÚÉú³É½á¹ûµÄ»·¾³£¬MLflow Ìṩ»ùÓÚ Conda Óë Docker µÄ´úÂë´ò°ü¸ñʽ¡£ÎªÁ˽«Ä£Ðͽ»¸¶ÖÁ²»Í¬µÄ²¿Êðƽ̨£¬MLflow »¹ÌṩרÃŵÄÄ£ÐÍ´ò°ü¸ñʽ£¬ÔÊÐíÁ¢×ãÄ£ÐÍÌṩԤ²â½á¹û£¬Í¬Ê±±£ÁôÆäÖйØÓÚÄ£ÐÍ´´½¨µÄÊý¾ÝÓë´úÂë¹Øϵ¡£

MLflow ¾ßÓбà³ÌÓïÑÔÓëƽ̨ÖÐÁ¢ÐÔ£¬Äܹ»ÔÚ Linux¡¢Windows ÒÔ¼° MacOS ÉÏÔËÐУ¬ÇÒ¿ÉÒÔÓëÈκλúÆ÷ѧϰ¿â£¨°üÀ¨ TensorFlow¡¢PyTorch µÈ£©Ð­Í¬Ê¹Óá£MLflow ʹÓà Python ÓïÑÔ±àд£¬Òò´ËÔÚ Python Éú̬ϵͳÖÐÄܹ»·¢»Ó×î¼ÑЧ¹û¡£µ«ÆäͬʱҲÓë R ¼° Java ½ôÃܹØÁª£¬Í¬Ê±ÌṩÃæÏò´ó²¿·ÖÆäËûÓïÑÔÑ¡ÏîµÄ REST API¡£

Kubeflow

Kubeflow Õâ¸öÃû×ÖÌýÆðÀ´²»Ì«ÑÏË࣬±Ï¾¹ËüÖ±½Ó¾Í°Ñ IT ÁìÓòµ±ÏÂ×îÈÈÃŵÄÁ½¸ö´Ê»ã½áºÏÁËÆðÀ´¡ª¡ªKubernetes ¼ÓÉÏ»úÆ÷ѧϰ¡£È»¶ø£¬ËüÓÃʵ¼Ê±íÏÖÖ¤Ã÷ÁË×Ô¼ºµÄÄÜÁ¦£¬½â¾öÁ˳¤ÆÚÒÔÀ´Ò»Ö±À§ÈÅן÷Àà×éÖ¯µÄÁ½¸öÏÖʵÎÊÌ⣺ÈçºÎ½«»úÆ÷ѧϰÑо¿´Ó¿ª·¢»·¾³×ªÒƵ½Éú²ú»·¾³£¬ÒÔ¼°ÈçºÎ½«Ò£²â¼¼Êõ´ÓÉú²ú»·¾³×ªÒƻؿª·¢»·¾³£¨ÒÔʵÏÖÉî¶ÈÑо¿£©¡£

»ùÓڹȸè TensorFlow À©Õ¹Æ½Ì¨µÄ Kubeflow ÏîÄ¿ÒѾ­ÔÚ·¢Õ¹¹ý³ÌÖн¨Á¢Æð×Ô¼ºµÄÖÐÁ¢¶¨Î»£¬Äܹ»Ö§³Ö PyTorch¡¢MXNet ÒÔ¼° Chainer µÈ¾ºÕùÐÔ»úÆ÷ѧϰ¿â£¬²¢»ñµÃÁË Chase¡¢Î¢ÈíÒÔ¼°°¢Àï°Í°ÍµÈ¿Æ¼¼¾ÞÍ·µÄÖ§³ÖÓë¹±Ïס£×÷Ϊһ¸öÖÂÁ¦ÓÚ¼ò»¯»úÆ÷ѧϰģÐͲ¿Êð¡¢¹ÜÀíÓëÀ©Õ¹¹¤×÷µÄÏîÄ¿£¬Kubeflow ¾ø¶ÔÊǽñÄêÄËÖÁδÀ´¼¸ÄêÄÚÖµµÃ¸ß¶È¹Ø×¢µÄÖØÁ¿¼¶³É¹ûÖ®Ò»¡£

Delta Lake

Databricks ¹«Ë¾ÓÚ½ñÄêÔçЩʱºò¶Ô Delta Lake ½øÐÐÁË¿ªÔ´¡£ÕâÑùµÄÑ¡ÔñÁîÈ˾ªÑÈ£¬±Ï¾¹Õâ¼Ò¹«Ë¾¹ýÈ¥Ò»Ö±½«Æä×÷ΪÉÌÓòúÆ·Öв»¿É»òȱµÄÖØÒª×é³É²¿·Ö¡£Delta Lake ÓµÓд¦Àí PB ÉõÖÁ EB ¼¶Êý¾ÝµÄÇ¿´óÐÔÄÜ£¬¸ºÔð³äµ±Êý¾ÝºþÖеĴ洢²ã£¬¿ÉÌṩ ACID ת»»Óë¼òµ¥µÄÊý¾Ý°æ±¾¿ØÖƹ¦ÄÜ£¬£¬ÇÒÖ»Ðèͨ¹ý Apache Spark read º¯Êýµ÷Óô«µÝʱ¼ä´Á¼´¿ÉʵÏÖ¡°Ê±¼äÂÃÐУ¨time travel£©¡±¡£

ËäÈ» Delta Lake Éд¦ÓÚÔçÆÚ¿ªÔ´¿ª·¢½×¶Î£¨½ñÄê 6 Ô¸ոշ¢²¼ 0.2.0 °æ±¾£¬Ôö¼ÓÁË¶Ô AWS Óë Azure ÔÆ×ÊÔ´µÄÖ§³ÖÄÜÁ¦£©£¬µ«ÆäÒѾ­ÔÚ Viacom Óë McGraw Hill µÄÉú²ú»·¾³ÖÐÔËÐУ¬Òò´Ë´ó¼Ò¶ÔÆäÎȶ¨ÐÔÓ¦¸Ã²»±Øµ£ÐÄ¡£ÔÚ½ÓÏÂÀ´µÄ¼¸¸öÔÂÖУ¬ÏàÐÅ»áÓиü¶àÆóÒµ½« Delta Lake ÄÉÈë×Ô¼ºµÄÉú²ú¼¼ÊõÕ»¡£

  • ·¢±íÓÚ:
  • Ô­ÎÄÁ´½Ó£ºhttp://news.51cto.com/art/201910/603891.htm
  • ÈçÓÐÇÖȨ£¬ÇëÁªÏµ cloudcommunity@tencent.com ɾ³ý¡£

Ïà¹Ø¿ìѶ

ɨÂë

Ìí¼ÓÕ¾³¤ ½ø½»Á÷Ⱥ

ÁìȡרÊô 10ÔªÎÞÃż÷ȯ

˽Ïí×îР¼¼Êõ¸É»õ

ɨÂë¼ÓÈ뿪·¢ÕßÉçȺ
Áìȯ
http://www.vxiaotou.com