Seminar on Internet Technologies (Summer 2024): Difference between revisions

From NET Wiki
Jump to navigation Jump to search
(Created page with "== Details == {{CourseDetails |credits=5 ECTS (BSc/MSc AI); 5 (ITIS) |lecturer=[http://user.informatik.uni-goettingen.de/~fu Prof. Xiaoming Fu] |ta =[http://www.net.informat...")
 
 
(10 intermediate revisions by 4 users not shown)
Line 7: Line 7:
|ta =[http://www.net.informatik.uni-goettingen.de/?q=people/jiaquan-zhang MSc. Jiaquan Zhang];
|ta =[http://www.net.informatik.uni-goettingen.de/?q=people/jiaquan-zhang MSc. Jiaquan Zhang];
|'''Please read this introduction slide [https://docs.google.com/presentation/d/13hmKYBmB4tbTFNeK1GvBAs1qZntMYo75o8ycb1NgYXI/edit?usp=sharing]. If there is any question, please contact teaching assistants.'''
|'''Please read this introduction slide [https://docs.google.com/presentation/d/13hmKYBmB4tbTFNeK1GvBAs1qZntMYo75o8ycb1NgYXI/edit?usp=sharing]. If there is any question, please contact teaching assistants.'''
|ta = Dr. Tingting Yuan [tingting.yuan@informatik.uni-goettingen.de]
|ta = Tong Shen[shen.tong@cs.uni-goettingen.de]
|time='''Please read this introduction slide [https://docs.google.com/presentation/d/13hmKYBmB4tbTFNeK1GvBAs1qZntMYo75o8ycb1NgYXI/edit?usp=sharing]. If there is any question, please contact teaching assistants.'''
|time='''Please read this introduction slide [https://docs.google.com/presentation/d/13hmKYBmB4tbTFNeK1GvBAs1qZntMYo75o8ycb1NgYXI/edit?usp=sharing]. If there is any question, please contact teaching assistants.'''
}}
}}
Line 38: Line 38:


==Schedule==
==Schedule==
* '''03.07.2023''': Deadline for registration to attend the final presentation
* '''03.07.2024''': Deadline for registration to attend the final presentation
* '''20.07.2023''' : Final Presentations (Online, wait to decide)
* '''20.07.2024''' : Final Presentations (Online, wait to decide)
* '''30.08.2023 (23:59) ''': Deadline for submission of the report (should be sent to the topic adviser!).
* '''30.08.2024 (23:59) ''': Deadline for submission of the report (should be sent to the topic adviser!).


== Topics ==
== Topics ==
Line 61: Line 61:
|-
|-
|-
|-
|AI painter
| How to do efficient offline training
| In this topic, you will study how AI has been used for painting. e.g. GAN.
| In this topic, you will study how to do efficient offline training for reinforcement learning
| Basic programming knowledge, Basic machine learning knowledge, need coding work
| Basic programming knowledge, Basic machine learning knowledge, need coding work
| [Tingting Yuan, tingt.yuan@hotmail.com]
| [Tingting Yuan, tingting.yuan@cs.uni-goettingen.de]
|[https://topten.ai/ai-painting-generators/]
|
| Yes
| Yes
|-
|-
|-
|-
|OCR (Optical Character Recognition) and Annotation Transfer
| Disaster Monitoring
| The aim of the project is to develop a tool/software that can convert a printed paper with annotations and text into electronic versions with text highlighting and annotations
| In this topic, you will study methods to monitor disaster scenarios (e.g. floodings) with aerial images.
| Basic machine learning knowledge
| Basic machine learning knowledge
| [Tingting Yuan, tingt.yuan@hotmail.com]
| [Fabian Wölk, fabian.woelk@cs.uni-goettingen.de]
|[https://medium.com/analytics-vidhya/opencv-perspective-transformation-9edffefb2143] [https://www.cameralyze.co/blog/how-can-i-detect-lines-in-images-or-pdfs] [https://developer.adobe.com/document-services/apis/pdf-services/]
|
| Yes
| No
|-
|-
|-
| Change Detection in Satellite Image Time Series
| Biomass estimation from Satellite Images
| In this topic, you will study methods to detect changes in land-use, vegetation, etc. in Satellite Image Time Series.
| In this topic, you will study methods to estimate the biomass of trees from satellite images.
| Basic machine learning knowledge
| Basic machine learning knowledge
| [Fabian Wölk, fabian.woelk@cs.uni-goettingen.de]
| [Fabian Wölk, fabian.woelk@cs.uni-goettingen.de]
Line 85: Line 85:
|-
|-
|-
|-
| Satellite Image Pixel Clustering for Change Estimation
| Explainable AI(XAI) / graph neural network (XGNN)
| In this topic, you will study pixel clustering methods for satellite images and apply their outputs for regression-based estimation of changes between different points in time.
| In this topic, student will study how AI models / GNNs are explained by SOTA papers.
| Basic machine learning knowledge
| Basic AI / GNN knowledge
| [Fabian Wölk, fabian.woelk@cs.uni-goettingen.de]
| [Zhengze Li, zhengze.li@cs.uni-goettingen.de]
|
|
| Yes
| Yes
|-
|-
|-
|-
| Explainable AI(XAI) / graph neural network (XGNN)
| Anomaly Detection in Graphs
| In this topic, students study how AI models / GNNs are explained with SOTA papers.
| In this topic, student will read papers to learn how to detect anomaly edge/graph/subgraph… with the help of GNN.
| Basic AI / GNN knowledge
| Basic AI / GNN knowledge
| [Zhengze Li, zhengze.li@cs.uni-goettingen.de]
| [Zhengze Li, zhengze.li@cs.uni-goettingen.de]
Line 102: Line 102:
|-
|-
| Social Media Comments Network (Intern/Project/Thesis possible)
| Social Media Comments Network (Intern/Project/Thesis possible)
| In this topic, you will study methods to crawl the dataset from social networks(e.g. YouTube) and utilize social science network analysis in any topic you are interested in (science/education/language…) to find out the network structure and compare the difference among different topics.
| In this topic, student will study methods to crawl the dataset from social networks(e.g. X, YouTube) and utilize social network analysis in any topic you are interested in (science/education/language…) to find out the network structure and compare the difference among different topics.
| Python(Data crawling, cleaning, statistical data analysis, modeling and visualization), basic graph knowledge
| Python(Data crawling, cleaning, statistical data analysis, modeling and visualization), basic graph knowledge would be a plus
| [Zhengze Li, zhengze.li@cs.uni-goettingen.de]
| [Zhengze Li, zhengze.li@cs.uni-goettingen.de]
|
|
| No
| No
|-
|-
| Influence of LLM robots in social networks (Intern/Project/Thesis possible)
| In this topic, student will study methods to crawl the data of LLM robots from social networks(e.g. X, Facebook) and utilize NLP and SNA to evaluate the influence of LLM robots in a specific topic.
| Python(Data crawling, cleaning, statistical data analysis, modeling and visualization), basic graph knowledge would be a plus
| [Zhengze Li, zhengze.li@cs.uni-goettingen.de]
|
| Yes
|-
|-
|-
|-
| The life-circle of vanished scientific journals (Intern/Project/Thesis possible)
| The life-circle of vanished scientific journals (Intern/Project/Thesis possible)
| In this topic, students will mine the information of vanished/(ongoing)/top journals, try to find out the difference features(manually/ML-based method) between journals facing different destinies.
| In this topic, student will mine the information of vanished/(ongoing)/top journals, try to find out the difference features(manually/ML-based method) between journals facing different destinies.
| Python(Data Crawling, Cleaning, EDA, Modeling). Basic graph, XAI knowledge is a plus.
| Python(Data Crawling, Cleaning, EDA, Modeling). Basic graph, XAI knowledge is a plus.
| [Zhengze Li, zhengze.li@cs.uni-goettingen.de]
| [Zhengze Li, zhengze.li@cs.uni-goettingen.de]
Line 118: Line 126:
|-
|-
| Traffic prediction with GNN (Intern/Project/Thesis possible)
| Traffic prediction with GNN (Intern/Project/Thesis possible)
| In this topic, students will study how to use XGNN to predict traffic volumn.
| In this topic, student will study how to use XGNN to predict traffic volumn.
| Python(Modeling and Visualization). Graph and XAI knowledge.
| Python(Modeling and Visualization). Graph and XAI knowledge.
| [Zhengze Li, zhengze.li@cs.uni-goettingen.de]
| [Zhengze Li, zhengze.li@cs.uni-goettingen.de]
Line 126: Line 134:
|-
|-
| ML/DL based industrial equipment predictive maintenance (Intern/Project/Thesis possible)
| ML/DL based industrial equipment predictive maintenance (Intern/Project/Thesis possible)
| In this topic, students will study how to use cutting-edge machine learning models to predict when industrial equipment need to be maintained before crashing.
| In this topic, student will study how to use cutting-edge machine learning models to predict when industrial equipment need to be maintained before crashing.
| Python(Cleaning, EDA, Modeling and Visualization). XAI knowledge is a plus.
| Python(Cleaning, EDA, Modeling and Visualization). XAI knowledge is a plus.
| [Zhengze Li, zhengze.li@cs.uni-goettingen.de]
| [Zhengze Li, zhengze.li@cs.uni-goettingen.de]
Line 138: Line 146:
| [Zhengze Li, zhengze.li@cs.uni-goettingen.de]
| [Zhengze Li, zhengze.li@cs.uni-goettingen.de]
|  
|  
| Yes
| No
|-
|-
|-
|-
| Open topics
| Lidar-based traffic flow analysis
| Open topics in Data Science & Applied Statistics, especially XAI
| In this topic, you will study methods to analyze traffic usage on roads, e.g., in terms of traffic flow, speed, and density to identify patterns and trends.
| Depends
| Basic point cloud processing & ML knowledge
| [Zhengze Li, zhengze.li@cs.uni-goettingen.de]
|
| Yes
|-
|-
| Vision-based pedestrian distribution monitoring
| In this topic, you will study methods to do macroscopic pedestrian detection aims to estimate crowd density without distinguishing each pedestrian.
| Basic CV & ML knowledge
| [Yanlong Huang, yanlong.huang@cs.uni-goettingen.de]
| [Yanlong Huang, yanlong.huang@cs.uni-goettingen.de]
|  
|  
Line 157: Line 157:
|-
|-
|-
|-
| Vision-based traffic usage analysis
| Personalized chatbot based on ChatGPT
| In this topic, you will study methods to analyze traffic usage on roads and highways, e.g., in terms of traffic flow, speed, and density to identify patterns and trends.
| In this topic, you will learn about ChatGPT and learn to use OpenAI ChatGPT API to create a personalized chatbot.
| Basic CV & ML knowledge
| NLP & ChatGPT
| [Yanlong Huang, yanlong.huang@cs.uni-goettingen.de]
| [Wenfang Wu, wenfang.wu@cs.uni-goettingen.de]
|  
|  
| Yes
| Yes
|-
|-
|-
|-
| Personalized chatbot based on ChatGPT
| Multimodal Large Language Model Evaluation for Multimodal Tasks
| In this topic, you will learn about ChatGPT and learn to use OpenAI ChatGPT API to create a personalized chatbot.
| This topic focuses on assessing the performance and effectiveness of large language models in handling tasks that involve multiple modalities, such as text, images, and audio. It involves the evaluation of these large models using specialized multimodal datasets, considering both quantitative metrics and qualitative analysis. In this topic, you will gain insights into various large models, including GPT-4, and acquire knowledge about a wide range of multimodal tasks. Additionally, you will become proficient in implementing evaluations related to these tasks.
| NLP & ChatGPT
| Large Language Model & multimodal setting
| [Wenfang Wu, wenfang.wu@cs.uni-goettingen.de]
| [Wenfang Wu, wenfang.wu@cs.uni-goettingen.de]
|  
|  
Line 173: Line 173:
|-
|-
|-
|-
| Performance of real 5G communication
| Knowledge Graph Completion
| What are the key QoS requirements for future applications and scenarios? What are the shortcomings of today's 5G network? Where are the bottlenecks? How can performance be improved? In this topic, you will build an open-source 5G communication network from the core to the edge, test and analyze the real performance of 5G.
| What are the Knowledge Graph (KG) requirements for future applications and scenarios? What is the task of Knowledge Graph Completion? What is the correlation between KGs and NLP? How to use popular large language models (LLMs) to assist in the implementation of knowledge graph completion? In this topic, you will learn about KGs and learn to use LLMs to perform a KGC task.
| Network protocol stack & 5G architecture
| Knowledge Graph & NLP
| [Wanghong Yang, wanghong.yang@cs.uni-goettingen.de]
| [Tong Shen, shen.tong@cs.uni-goettingen.de]
|  
|  
| Yes
| Yes

Latest revision as of 10:26, 23 May 2024

Details

Workload/ECTS Credits: 5 ECTS (BSc/MSc AI); 5 (ITIS)
Lecturer: Prof. Xiaoming Fu
Teaching assistant: Tong Shen[shen.tong@cs.uni-goettingen.de]
Time: Please read this introduction slide [1]. If there is any question, please contact teaching assistants.


Announcement

No open talk. You can contact your topic advisor to schedule a 1V1 meeting or talk.

Course description

This course covers selected topics on up-to-date Internet technologies and research. Each student chooses a topic, does a presentation, and writes a report on it. Besides the introduction meeting, there are no regular meetings, lectures, or classes for this course. The purpose of this course is to familiarize the students with new technologies, enable the independent study of a specific topic, and train presentation and writing skills.

The informational meeting at the beginning of the course will cover some guidelines on scientific presenting and writing.

Due to the topic advisors' workload limitation, we could only provide limited topics, and the topic assignment will be on the basis of the first come first serve principle. Please contact the topic advisor directly for the topic availability.

Note: Participants in the seminar only need to register for the exam before the end of the course.

Passing requirements

  • There will be 2 milestones before the presentations that the students should pass before they register for the course.
    • Intro milestone where the adviser makes sure that the student starts to work on the topic and follows an accepted methodology.
    • Midterm milestone. (ex. programming tasks are done etc... )
  • Actively and frequently participate in the project communication with the topic advisor
    • This accounts for 20% of your grade.
  • Present the selected topic (20 min. presentations + 10 min. Q&A).
    • This accounts for 40% of your grade.
  • Write a report on the selected topic (6-8 pages) (LaTeX Template:[2]).
    • This accounts for 40% of your grade.
  • Please check the #Schedule and adhere to it.

Schedule

  • 03.07.2024: Deadline for registration to attend the final presentation
  • 20.07.2024 : Final Presentations (Online, wait to decide)
  • 30.08.2024 (23:59) : Deadline for submission of the report (should be sent to the topic adviser!).

Topics

Topic Description Prerequisites Topic Advisor Readings Available
Privacy protection in video analytics In this topic, you will study how to do privacy protection in video analytics, e.g., video blur Basic programming knowledge, Basic machine learning knowledge, need coding work [Tingting Yuan, tingting.yuan@cs.uni-goettingen.de] Yes
How to do efficient offline training In this topic, you will study how to do efficient offline training for reinforcement learning Basic programming knowledge, Basic machine learning knowledge, need coding work [Tingting Yuan, tingting.yuan@cs.uni-goettingen.de] Yes
Disaster Monitoring In this topic, you will study methods to monitor disaster scenarios (e.g. floodings) with aerial images. Basic machine learning knowledge [Fabian Wölk, fabian.woelk@cs.uni-goettingen.de] No
Biomass estimation from Satellite Images In this topic, you will study methods to estimate the biomass of trees from satellite images. Basic machine learning knowledge [Fabian Wölk, fabian.woelk@cs.uni-goettingen.de] No
Explainable AI(XAI) / graph neural network (XGNN) In this topic, student will study how AI models / GNNs are explained by SOTA papers. Basic AI / GNN knowledge [Zhengze Li, zhengze.li@cs.uni-goettingen.de] Yes
Anomaly Detection in Graphs In this topic, student will read papers to learn how to detect anomaly edge/graph/subgraph… with the help of GNN. Basic AI / GNN knowledge [Zhengze Li, zhengze.li@cs.uni-goettingen.de] Yes
Social Media Comments Network (Intern/Project/Thesis possible) In this topic, student will study methods to crawl the dataset from social networks(e.g. X, YouTube) and utilize social network analysis in any topic you are interested in (science/education/language…) to find out the network structure and compare the difference among different topics. Python(Data crawling, cleaning, statistical data analysis, modeling and visualization), basic graph knowledge would be a plus [Zhengze Li, zhengze.li@cs.uni-goettingen.de] No
Influence of LLM robots in social networks (Intern/Project/Thesis possible) In this topic, student will study methods to crawl the data of LLM robots from social networks(e.g. X, Facebook) and utilize NLP and SNA to evaluate the influence of LLM robots in a specific topic. Python(Data crawling, cleaning, statistical data analysis, modeling and visualization), basic graph knowledge would be a plus [Zhengze Li, zhengze.li@cs.uni-goettingen.de] Yes
The life-circle of vanished scientific journals (Intern/Project/Thesis possible) In this topic, student will mine the information of vanished/(ongoing)/top journals, try to find out the difference features(manually/ML-based method) between journals facing different destinies. Python(Data Crawling, Cleaning, EDA, Modeling). Basic graph, XAI knowledge is a plus. [Zhengze Li, zhengze.li@cs.uni-goettingen.de] Yes
Traffic prediction with GNN (Intern/Project/Thesis possible) In this topic, student will study how to use XGNN to predict traffic volumn. Python(Modeling and Visualization). Graph and XAI knowledge. [Zhengze Li, zhengze.li@cs.uni-goettingen.de] Yes
ML/DL based industrial equipment predictive maintenance (Intern/Project/Thesis possible) In this topic, student will study how to use cutting-edge machine learning models to predict when industrial equipment need to be maintained before crashing. Python(Cleaning, EDA, Modeling and Visualization). XAI knowledge is a plus. [Zhengze Li, zhengze.li@cs.uni-goettingen.de] Yes
AI for High-quality Image Restoration and Manipulation (Intern/Project/Thesis possible) Image restoration and manipulation are low-level vison problems aiming to either restore the degraded images for higher perceptual quality (such as better color, contrast brightness, etc.) or manipulate image styles content for better understanding or visual-appealing effects. Moreover, such problems also plays key role for many high-level computer vision tasks, including image detection, recognition and (semantic) segmentation... In this topic, students need to follow the new trends and advances in the area of many sup-problem and explore new methods for completive or superior opportunity for academic and industrial applications. Python & CV knowledge. [Zhengze Li, zhengze.li@cs.uni-goettingen.de] No
Lidar-based traffic flow analysis In this topic, you will study methods to analyze traffic usage on roads, e.g., in terms of traffic flow, speed, and density to identify patterns and trends. Basic point cloud processing & ML knowledge [Yanlong Huang, yanlong.huang@cs.uni-goettingen.de] Yes
Personalized chatbot based on ChatGPT In this topic, you will learn about ChatGPT and learn to use OpenAI ChatGPT API to create a personalized chatbot. NLP & ChatGPT [Wenfang Wu, wenfang.wu@cs.uni-goettingen.de] Yes
Multimodal Large Language Model Evaluation for Multimodal Tasks This topic focuses on assessing the performance and effectiveness of large language models in handling tasks that involve multiple modalities, such as text, images, and audio. It involves the evaluation of these large models using specialized multimodal datasets, considering both quantitative metrics and qualitative analysis. In this topic, you will gain insights into various large models, including GPT-4, and acquire knowledge about a wide range of multimodal tasks. Additionally, you will become proficient in implementing evaluations related to these tasks. Large Language Model & multimodal setting [Wenfang Wu, wenfang.wu@cs.uni-goettingen.de] Yes
Knowledge Graph Completion What are the Knowledge Graph (KG) requirements for future applications and scenarios? What is the task of Knowledge Graph Completion? What is the correlation between KGs and NLP? How to use popular large language models (LLMs) to assist in the implementation of knowledge graph completion? In this topic, you will learn about KGs and learn to use LLMs to perform a KGC task. Knowledge Graph & NLP [Tong Shen, shen.tong@cs.uni-goettingen.de] Yes

Workflow

1. Select a topic

Each student needs to choose a topic from the list. You can start to work on your selected topic at any time. However, please make sure to notify the advisor of your selected topic in advance, because you might be refused by the advisor if someone has registered on the same topic.

2. Get your work advised

Each topic has an advisor, who will help you to solve problems regarding the topic. Please do not hesitate to contact your advisor. It is recommended (and not mandatory) that you can schedule a skype or zoom meeting with your advisor right after you select your topic. Your advisor will give you some useful guidance and suggestions, which will help you to gain more from this course.

3. Approach your topic

  • By choosing a topic, you will get a direction of elaboration.
  • You may work in different styles, for example:
    • Survey: Basic introduction, an overview of the field; general problems, methods, approaches.
    • Specific problem: Detailed introduction, details about the problem, and the solution.
  • Based on the research, you should have your own ideas on your topic.

4. Prepare presentation

  • Present on your topic to the audience (in English).
  • 20 minutes of presentation followed by 10 minutes of discussion.

You need to present your topic to an audience of students and other interested people (usually the NET group members). Your presentation should include your general idea of your topic and highlight interesting problems and solutions. You must finish your presentation within a limited time. You have 20 minutes to present your topic followed by 10 minutes of discussion. It is highly recommended to send your slides to your topic advisor in advance, he/she will give you help with your presentation.

Hints for preparing the presentation: If your topic includes many aspects, and 20 minutes is too short for you to introduce them all, it is recommended to focus on one certain important aspect. Besides, you can discuss with your advisor, he/she will help you to reduce the content. Please make sure to finish your presentation in time.

Suggestions for preparing the slides: No more than 20 pages/slides. Get your audiences to quickly understand the general idea. Figures, tables, and animations are better than sentences. Don't forget a summary of the topic and your ideas.

5. Write a report

  • Present the problem with its background.
  • Detail the approaches, techniques, and methods to solve the problem.
  • Evaluate and assess those approaches (e.g., pros and cons).
  • Give a short outlook on potential future developments.

The report must be written in English according to common guidelines for scientific papers, between 6 and 8 pages of content (excluding bibliography, etc.). Please note that you can not directly copy content from papers or webpages, as this will be considered plagiarism. All quoted images and tables need to indicate their source.

6. Course schedule

There are no regular meetings, lectures, or classes for this course. The work is expected to be done by yourself with the assistance of your topic advisor. Please follow the #Schedule to take appropriate actions.