Xavier Llorà » Estimation of Distribution Algorithms http://www.xavierllora.net A notebook about data-intensive computing, genetics-based machine learning, semantic-web technology, cloud computing, and more. Thu, 15 Jul 2010 19:50:19 +0000 en hourly 1 http://wordpress.org/?v=3.0 Scaling eCGA Model Building via Data-Intensive Computing http://www.xavierllora.net/2010/04/08/scaling-ecga-model-building-via-data-intensive-computing/ http://www.xavierllora.net/2010/04/08/scaling-ecga-model-building-via-data-intensive-computing/#comments Thu, 08 Apr 2010 16:17:39 +0000 Xavier http://www.xavierllora.net/?p=664
  • Scaling Genetic Algorithms using MapReduce
  • Data-Intensive Computing for Competent Genetic Algorithms: A Pilot Study using Meandre
  • Data-Intensive Computing for Competent Genetic Algorithms: A Pilot Study using Meandre
    • ]]>     I just uploaded the technical report of the paper we put together for CEC 2010 on how we can scale up eCGA using a MapReduce approach. The paper, besides exploring the Hadoop implementation, it also presents some very compelling results obtained with MongoDB (a document based store able to perform parallel MapReduce tasks via sharding). The paper is available as PDF and PS.

    Abstract:
    This paper shows how the extended compact genetic algorithm can be scaled using data-intensive computing techniques such as MapReduce. Two different frameworks (Hadoop and MongoDB) are used to deploy MapReduce implementations of the compact and extended com- pact genetic algorithms. Results show that both are good choices to deal with large-scale problems as they can scale with the number of commodity machines, as opposed to previous ef- forts with other techniques that either required specialized high-performance hardware or shared memory environments.

    Related posts:

    1. Scaling Genetic Algorithms using MapReduce
    2. Data-Intensive Computing for Competent Genetic Algorithms: A Pilot Study using Meandre
    3. Data-Intensive Computing for Competent Genetic Algorithms: A Pilot Study using Meandre

    ]]>     http://www.xavierllora.net/2010/04/08/scaling-ecga-model-building-via-data-intensive-computing/feed/ 1     Data-Intensive Computing for Competent Genetic Algorithms: A Pilot Study using Meandre http://www.xavierllora.net/2009/07/13/data-intensive-computing-for-competent-genetic-algorithms-a-pilot-study-using-meandre-2/ http://www.xavierllora.net/2009/07/13/data-intensive-computing-for-competent-genetic-algorithms-a-pilot-study-using-meandre-2/#comments Tue, 14 Jul 2009 04:15:51 +0000 Xavier http://www.xavierllora.net/?p=563
  • Data-Intensive Computing for Competent Genetic Algorithms: A Pilot Study using Meandre
  • Meandre: Semantic-Driven Data-Intensive Flows in the Clouds
  • Scaling Genetic Algorithms using MapReduce
    • ]]>     Below you may find the slides I used during GECCO 2009 to present the paper titled “Data-Intensive Computing for Competent Genetic Algorithms: A Pilot Study using Meandre”. An early preprint in form of technical report can be found as an IlliGAL TR No. 2009001 or the full paper at the ACM digital library

    Related posts:

    1. Data-Intensive Computing for Competent Genetic Algorithms: A Pilot Study using Meandre
    2. Meandre: Semantic-Driven Data-Intensive Flows in the Clouds
    3. Scaling Genetic Algorithms using MapReduce

    ]]>     http://www.xavierllora.net/2009/07/13/data-intensive-computing-for-competent-genetic-algorithms-a-pilot-study-using-meandre-2/feed/ 0