主要负责从各种视频和新闻网站上爬取各种资料,这些网站包括但不限于抖音,bilibili, 小红书,视频号、百加号,今日头条,tiktok,youtube, facebook, reddit, x(tiwwer), instagram, 西瓜视频,百度新闻,163新闻,新浪新闻, cnn,Fox News,ABC News,CBS News,The New York Times,netflix等。我主要使用Python作为编程语言,并利用Scrapy等高效的工具来执行爬虫任务
He is mainly responsible for crawling various materials from various video and news websites, including but not limited to Tiktok, Bilibili, Xiaohongshu, video number, Baijia, Today s Headlines, tiktok, YouTube, Facebook, reddit, x (tiwwer), instagram, watermelon video, Baidu News, 163 News, Sina News, cnn, Fox News, ABC News, CBS News, The New York Times, netflix, etc. I mainly use Python as the programming language, and use efficient tools such as Scrapy to perform crawler tasks (2024-03-25, Others, 0KB, 下载0次)
一个python web scraper，它将抓取Municode Library并搜索所有列出的市镇，并识别在其分区部分中提到“数据中心”的任何州县市政索引，以正确地突出未来数据中心发展的潜在位置。
A python web scraper that will crawl the Municode Library and search through all listed municipalities and identify any state county muni index that mentions "data center" within their zoning section to highlight potential locations for future data center development by-right. (2024-03-24, Others, 0KB, 下载0次)
通用新闻信息爬虫。
A general news information crawler. (2024-03-21, Others, 0KB, 下载0次)
新闻港是一个Python迷你项目，旨在使用网络抓取技术收集和组织来自不同在线来源的新闻。
News harbour is a Python mini-project aimed at collecting and organising news from diverse online sources using web scraping techniques. (2024-03-19, Others, 0KB, 下载0次)
我们从“大产业”中“小场景”出发着眼于“解决用户痛点”期望通过产品项目化实施,降本增效达到20%以上,并缩短开发周期70%。在这个价值观驱动下,深度整合我们已有的“数据采集+数字孪生+AI大模型”软硬件系列产品线来重新定义“孪生体”并开发出一款名为“zctechX”的数字化中心平台产品。zctechX同时支持B S和C S架构,旨在通过数据采集、数字孪生和AI大模型等技术帮助用户实现智能运营、设备健康管理、能效优化以及质量预测等目标。
We start from the "small scene" in the "big industry" and focus on "solving user pain points". We expect that through the implementation of product projects, cost reduction and efficiency increase will reach more than 20%, and the development cycle will be shortened by 70%. Driven by this value, we have deeply integrated our existing software and hardware product lines of "data acquisition+digital twins+AI big model" to redefine the "twins" and developed a digital central platform product called "zctechX". ZctechX supports both B S and C S architectures. It aims to help users achieve the goals of intelligent operation, equipment health management, energy efficiency optimization and quality prediction through data collection, digital twins, AI big model and other technologies. (2024-03-02, Others, 0KB, 下载0次)
Web新闻爬网
Web News Crawling (2023-12-27, Others, 0KB, 下载0次)
HotList是基于Python Spider + FastAPI 实现的今日热榜 热搜榜单 新闻热榜 全网热点榜单的编程接口,,API接口涵盖:微博、今日头条、豆瓣、百度、虎嗅、IT之家、BiliBili等全网热点榜单。
HotList is a programming interface based on Python Spider+FastAPI for the hot list of today s hot list, the hot list of news, the hot list of the whole network. The API interface covers microblog, today s headlines, Douban, Baidu, Tiger Smell, IT Home, BiliBili and other hot lists of the whole network. (2023-11-18, Others, 0KB, 下载0次)
基于Python的Web Scraper实现了Beautiful Soup Package来抓取关于关键字的最新新闻，
Python based Web Scraper implemented Beautiful Soup Package to scrape for recent news regarding a key word, (2023-10-16, Others, 0KB, 下载0次)
提供人工智能、文件存储、套接字聊天、web爬行和产品列表等功能的统一中心平台。潜入并探索...，
A unified hub platform providing functionalities like AI, file storage, socket chat, web crawling, and a product list. Dive in and explore more! (2023-08-22, Others, 0KB, 下载0次)
自动Python脚本，用于从Business Recorder中web抓取金融新闻文章、执行情绪分析和存储结果，
Automated Python script for web scraping financial news articles from Business Recorder, performing sentiment analysis, and storing results, (2023-08-22, Others, 0KB, 下载0次)
“为数据工程任务定制的基本Python代码段的中心。探索文件操作、web抓取、数据转换…，
"Your hub for essential Python code snippets tailored for data engineering tasks. Explore file manipulation, web scraping, data transform…, (2023-08-15, Others, 0KB, 下载0次)
该存储库包含web爬行进程和mysql数据库连接池的框架，以及新浪新闻和...的实现...，
This repository contains a framework of web crawling process and mysql database connection pools, and an implementation of sina news and weibo crawling (2014-04-04, Others, 0KB, 下载0次)
本项目初衷为大学、医院、科研中心等更方便的操作影像数据。包括:数据收集、发送、匿名化、查询、共享等基础服务。可以把共同参与同一课题研究的所有被试数据组成为一个DataSet。该数据集包含从CT\磁共振等影像设备采集来的MateData...
The original intention of this project is to facilitate the operation of image data in universities, hospitals, research centers, etc. It includes basic services such as data collection, sending, Data anonymization, query and sharing. All participants data participating in the same research topic can be combined into a Dataset. This dataset contains MateData collected from imaging devices such as CT/MRI (2020-10-29, Others, 38KB, 下载0次)