OSDN -- 오픈 소스 소프트웨어 개발 및 다운로드
Translation Status of 한국말 translation status for ko

RSS
Download List

프로젝트 설명

Ebot is a scalable and distribuited Web crawler. The URLs are saved to a NOSQL database (which supports map/reduce queries) that you can query via RESTful HTTP requests or using your preferred programming languages. The URLs that need to be analyzed are sent to AMQP queues. In this way, it is possible to run several crawlers in parallel and stop and start them without losing URLs.

System Requirements

System requirement is not defined
Information regarding Project Releases and Project Resources. Note that the information here is a quote from Freecode.com page, and the downloads themselves may not be hosted on OSDN.

2010-06-08 16:40
0.4

사용자 정의 / 외부 신체 분석기 및 URL normalizers 이제 지원됩니다. 구성 파일이 표준화되었다.
Custom/external body analyzers and URL normalizers are now supported. The configuration files were standardised.

2010-05-30 04:26
0.3

기본값은 여전히 아파치 couchdb입니다 비록 초기 지원 Riak위한 백엔드 데이터베이스로, 추가되었습니다. 원격 DB 및 AMQP 서버에 연결하기위한 새로운 옵션이 추가되었다.
Initial support was added for Riak as a backend database, though the default is still Apache couchdb. New options for connecting to remote DB and AMQP servers were added.

2010-05-20 05:46
2010-05-19

통계 DB 용 (추가되었습니다 URL의 수,베이스 크기), amqp (대기열 카운트), 그리고 RRDTOOL와 웹 (크롤 러).
Statistics have been added for db (number of urls, db size), amqp (queues counts), and web (crawlers) with RRDTOOL.

Project Resources

Home Page Project Page