联合开发网   搜索   要求与建议
                登陆    注册
排序按匹配   按投票   按下载次数   按上传日期
按分类查找All 数据采集/爬虫(95) 
按平台查找All Java(95) 

[数据采集/爬虫] WebCrawling

Java程序用于从网站抓取数据,然后将其放入json文件,或使用put方法将其发送到指定的服务器
Java program used to crawl data from websites and then put it into a json file or send it to the specified server using put method (2024-03-23, Java, 0KB, 下载0次)

http://www.pudn.com/Download/item/id/1711247685247063.html

[数据采集/爬虫] zx-common

Bean转换、http请求、json解析、方法重试、SPEL与aop参数解析、方法环绕日志、RPC负载均衡调用、注解+spel分布式RedLock、爬虫请求执行器
Bean conversion, http request, json resolution, method retry, SPEL and aop parameter resolution, method wrapping log, RPC load balancing call, annotation+spel distributed RedLock, crawler request executor (2023-11-13, Java, 0KB, 下载0次)

http://www.pudn.com/Download/item/id/1699870791184550.html

[数据采集/爬虫] spyder

采用自动化测试技术(Selenium),达到模拟人操作浏览器的效果。突破了天猫平台反爬虫技术的封锁;调用天猫自身搜索引擎,实现了精准地抓取所需数据;用多线程实现了批量快速地抓取商品详情、购物评论等数据。
Automatic test technology (Selenium) is adopted to achieve the effect of simulating human operating the browser. Breaking through the blockade of anti crawler technology on Tmall platform; Call Tmall s own search engine to accurately capture the required data; With multithreading, it can quickly capture the details of goods, shopping comments and other data in batches. (2017-03-06, Java, 1097KB, 下载0次)

http://www.pudn.com/Download/item/id/1686570385131215.html

[数据采集/爬虫] getefnews

定时使用多线程爬虫从endless frontier服务器爬取游戏活动资料,并通过网页展示。涉及技术:spring boot, java多线程爬虫, 异步处理, 线程池, 连接池, redis, mybatis
Regularly use the multithreaded crawler to crawl the game activity data from the endless frontier server and display it through the webpage. Technologies involved: spring boot, java multithreaded crawler, asynchronous processing, thread pool, connection pool, redis, mybatis (2018-05-23, Java, 124KB, 下载0次)

http://www.pudn.com/Download/item/id/1686570075544035.html

[数据采集/爬虫] spider-zhihu

一个自带免费代理池的爬虫小项目。以RESTFul接口的方式暴露了知乎用户数据的爬取、清洗、迁移等服务。项目可在本地启动,也可在云服务器上以docker容器的方式启动。
A small crawler project with a free proxy pool. The service of crawling, cleaning and migration of Zhihu user data is exposed in the way of RESTful interface. The project can be started locally or on the ECS as a docker container. (2019-11-25, Java, 161KB, 下载0次)

http://www.pudn.com/Download/item/id/1686569905735038.html

[数据采集/爬虫] java-web-crawler

这是java中网页爬行的一个非常基本的例子,并且不是完全可用于生产的爬行器,是为...
This is pretty basic example of web page crawling in java and is not fully production ready crawler and is done for test purposes only (2022-09-01, Java, 8KB, 下载0次)

http://www.pudn.com/Download/item/id/1686104878202897.html

[数据采集/爬虫] Mobileclient

利用传感器和ZigBee采集传输农场大棚的数据, ARM S5PV210平台对数据进行维护检测;Android终端访问数据并接收警报。Android终端app的开发
Using sensors and ZigBee to collect and transmit data from farm greenhouses, the ARM S5PV210 platform maintains and detects the data; Android terminals access data and receive alerts. Development of Android terminal app (2016-03-02, Java, 6272KB, 下载0次)

http://www.pudn.com/Download/item/id/1686102987292648.html

[数据采集/爬虫] Wireless-signal-acquisition-mobile-phone-software

Collect wireless signals from surrounding routers through the mobile app, and package the collected data to the server for processing and display positioning..通过手机app采集周围的路由器无线信号,并将采集到的数据进行打包发送到服务端进行处理显示定位
Collect wireless signals from surrounding routers through the mobile app, and package the collected data to the serve... (2019-09-26, Java, 4678KB, 下载0次)

http://www.pudn.com/Download/item/id/1686102580442451.html

[数据采集/爬虫] WifiTest

实验室项目用,测试WiFi信号的RSSI值,自动过滤不相关路由器,可以设定采样频率,采集十组数据,自动求平均值,非常方便。
Used in laboratory projects to test the RSSI value of WiFi signals, automatically filter irrelevant routers, set sampling frequency, collect ten sets of data, and automatically calculate the average value, which is very convenient. (2016-02-16, Java, 95KB, 下载0次)

http://www.pudn.com/Download/item/id/1686102551797830.html

[数据采集/爬虫] Woss

电信数据采集系统就是通过读取(AAA)服务器系统日志文件中用户登入登出信息。 得到用户登录系统的登入登出时刻、登录时长等数据。 最后把匹配处理好的数据保存成电信工作人员可以阅读的文本文件,做为电信收费依据。
The telecommunications data collection system reads user login and logout information from the (AAA) server system log file. Obtain data such as the login/logout time and login duration of the user s login system. Finally, save the matched data into a text file that telecom staff can read as the basis for telecom charging. (2017-10-07, Java, 5350KB, 下载0次)

http://www.pudn.com/Download/item/id/1686102485716699.html

[数据采集/爬虫] weibospider4

新浪微博,腾讯微博采集器,采集公共微博然后储存在数据库中,支持的参数设置:多任务多线程,正则表达式关键字过滤微薄,由hibernate自动建立数据库和表结构
Sina Weibo and Tencent Weibo collectors collect public Weibo posts and store them in a database. Supported parameter settings include multitasking and multithreading, regular expression keyword filtering, and automatic database and table structure establishment by hibernate (2016-01-29, Java, 62KB, 下载0次)

http://www.pudn.com/Download/item/id/1686102474732279.html

[数据采集/爬虫] zeus

zeus采集系统是一款java编写的数据采集发布爬虫软件,可部署在云服务器,免登录实时发布数据,全自动无需人工干预。系统还在持续更新中,希望给广大有需要的朋友带来更方便,体验更好的采集服务。
Zeus collection system is a data collection and publishing crawler software written in Java, which can be deployed on cloud servers, and can publish data in real-time without login. It is fully automated and does not require manual intervention. The system is still being continuously updated, hoping to bring more convenience and experience better collection services to friends in need. (2020-07-13, Java, 1731KB, 下载0次)

http://www.pudn.com/Download/item/id/1686102452234968.html

[数据采集/爬虫] Experiment4

基于MQTT协议,物联网云平台的智慧路灯管理系统,在PC机上(根据相应的开发技术选取开发环境)进行项目软件的Web开发,采集端的数据采用MQTT.fx进行模拟,数据通过MQTT协议进行传输到服务器,再获取服务器数据,并最终显示在前端应用中。
Based on the MQTT protocol and IoT cloud platform, a smart streetlight management system is developed on a PC (selecting a development environment according to the corresponding development technology) for the project software. The collected data is simulated using MQTT.fx, and transmitted to the server through the MQTT protocol. The server data is then obtained and finally displayed in the front-end application. (2020-07-06, Java, 14585KB, 下载0次)

http://www.pudn.com/Download/item/id/1686102330735897.html

[数据采集/爬虫] HIKIVISION-TWO-development

基于海康威视摄像头的二次开发,实现了可视化定点追踪。 基本原理:服务器端采集RFID坐标信息,下发至客户端,海康威视接口调用摄像头,自动定位到坐标位置。 这里只提交了客户端代码,大家可以模拟服务器端数据进行测试。
Based on the secondary development of Hikvision cameras, visual fixed point tracking has been achieved. Basic principle: The server collects RFID coordinate information and sends it to the client. The Hikvision interface calls the camera and automatically locates the coordinate position. Only the client code has been submitted here, and you can simulate server side data for testing. (2016-09-29, Java, 2046KB, 下载0次)

http://www.pudn.com/Download/item/id/1686102319770893.html

[数据采集/爬虫] jvmm

JVMM(JVM Monitor)是一个提供Java虚拟机和操作系统服务式监控的工具,拥有丰富的数据采集功能:OS(内存、CPU、磁盘状态及IO、网卡状态及IO等)、 JVM(内存、线程、线程池、内存池、GC、类加载器等),还提供生成...
JVMM (JVM Monitor) is a tool that provides Java virtual machine and operating system service-oriented monitoring. It has rich data collection functions: OS (memory, CPU, disk status and IO, network card status and IO, etc.), JVM (memory, thread, Thread pool, memory pool, GC, class loader, etc.), and also provides generation (2023-05-31, Java, 2633KB, 下载0次)

http://www.pudn.com/Download/item/id/1686102186805117.html
12345
总计:95