Good Deep Learning topic for Graduate Research Thesis … - BepalInfo

Good Deep Learning topic for Graduate Research Thesis …

Machine Learning & Robotics Lab

University Stuttgart

Master/Bachelor Thesis Topics

We publish possible thesis or project topics in our group here. If you are interested in one of the topics please contact the according advisor directly via email.

TopicAdvisorType
GPU Backend for Linear Algebra Lib Johannes Kulick Studienarbeit/small project
We want our linear algebra library to be ported to the magma library as backend. Magma uses the power of gpu and multi-cpu systems to boost the performance of linear algebra operations. Our system so far uses lapack as backend, which is fairly similar in syntax to magma, but unfortunately magma is not a simple drop-in replacement. So some adjustments must be made to make it work. This studienarbeit would also include writing unit-tests for the new backend (and thus for our linear algebra software as a whole).

Requirements: Coding skills in C++. Some knowledge about software design.

Physical reasoning Johannes Kulick Master thesis
In one of our research projects we need situations in a physical simulator, which are stable. E.g. no floating objects, no objects penetrating each other etc.. So far we use hard coded functions to generate these situations, but it would be much more interesting to actually reason about the physics. This could be done by modeling the world as probability distributions about the poses of all objects. Then techniques like rejection sampling could be used, but also true inference algorithms could be used.
The master thesis would include defining the probability distributions as well as implementing inference and/or sampling algorithms on these distributions.

Requirements: Knowledge about some statistical machine learning techniques (like EP, rejection sampling, importance sampling, MCMC etc.) or the willingness to learn them. Coding skills in Python (preferably) or C++.

Upcoming Colloquia

  • No upcoming events

AEC v1.0.4

  • Current Course Pages
    • Machine Learning (SS 18)
    • Reinforcement Learning (SS 18)
    • Deep Reinforcement Learning (SS 18)
    • Practical Course Robotics (SS 18)
  • Login
  • Logout

Press J to jump to the feed. Press question mark to learn the rest of the keyboard shortcuts

log in sign up Visit Old Reddit
r/

MachineLearning

Posts

0

Posted by

u/HyperSpectralVoice

2 years ago

Archived

Good Deep Learning topic for Graduate Research Thesis

Hello everyone!

I'm planning to do my graduate thesis on Deep Learning. I know the basics of Machine Learning (from Andrew Ng's Coursera Class) and Deep Learning (Nando de Freitas's Lectures). I've developed "deep" interest in this amazing field.

As a total beginner in this field, what do you guys suggest should I do my master's thesis on? What specific deep neural network architecture should I choose? What should be the task on which I should work on (considering that I'm totally new in this field)?

I still want to be a bit innovative and not exactly do what has already been done in this field. I'm eager to learn new things in this field.

So, please help me choose a good research topic to work on!

P. S. As a deep learning framework, I've chosen TensorFlow. Is it any good for newbies like me? I've quite a lot programming experience in C++, Java and a bit of Python, by the way.

Thanks!

3 comments

36% Upvoted
This thread is archived
New comments cannot be posted and votes cannot be cast
Sort by

level 1

alexmlamb

6 points · 2 years ago

Do it on Deep Learning for time series forecasting!!!

level 1

MetricSpade007

2 points · 2 years ago

I think the first step is to just read a lot of the current research that's in arXiv, or coming out of Deepmind or various research labs, and to really ask yourself what kind of AI you'd love to see manifested in real life. Better vision systems? Better NLP systems? Better learning systems? Once you've narrowed that down, and have read a good amount of current literature, I think the next directions will be easy.

level 1

XYcritic

1 point · 2 years ago

I think you have to find out for yourself. "Interesting topics" are highly subjective. Read lots and lots of papers until you get stuck at a specific idea.

Community Details
r/MachineLearning

460k

Subscribers

1.2k

Online

Create Post
Twitter

@slashML

r/MachineLearning Rules
1.
Be nice: no offensive behavior, insults or attacks
2.
Make your post clear and comprehensive
3.
Posts without appropriate tag will be removed
4.
Beginner or career related questions go elsewhere
5.
Self Posts Only*
about careers press
advertise blog help
the reddit app reddit coins reddit premium reddit gifts
content policy | privacy policy
user agreement | mod policy
© 2018 Reddit, Inc. All rights reserved




Researchproductions.com: A Complete Guide for Researchers

Research

What are hot topics for a Master thesis related to Deep Learning

By
Posted on

deep learning

Share
Tweet
Share
Email
Comments

Deep Learning (DL) is another way of representing data. It is a family of Machine Learning (ML). Some researchers consider DL as an advance form of ML. The other names of DL are deep structure learning and hierarchical learning. Moreover, It has enough potential to keep us busy for a long while.

If you are looking for some good research area in DL for your master’s or PhD thesis, then please have a quick review of Ian Goodfellow, Yoshua Bengio, and Aaron Courville books available for this task. There is a complete section in it for research.

Google, Amazon, Netflix and many other big companies  on the internet using DL to increase their sale rate. Such as from Google point of view, what are you looking for, what you have queried and the information available on the page is accurate or not are some areas where they optimise their results. Google has recently introduced Rank Brain which works according to it. On the other end, which movie you are watching and recommend a movie according to your taste are some areas where deep learning provides better results than the methodology adopted previously.

DL algorithms have various applications where human experts don’t produce efficient results. Other areas of DL are

  1. Computer Vision
  2. Speech Recognition
  3. Natural Language Processing (NLP)
  4. Social Network Analysis
  5. Recommender System
  6. Customer Relationship Management
  7. Machine Translation
  8. Bioinformatics

Dl and Machine Learning (ML) now hot topics for Master’s student. There are many ideas related to machine learning thesis and DL.

One of the hot topics on DL is Natural Language processing. Because Overfitting and underfitting are hot topics of research. Regularization has tried to overcome such issues, but you can extend this work using deep learning approaches.

Secondly, Extreme Learning Machines (ELM) has a lot of space for researchers. ELM is a feedforward neural network which has been used for classification, regressions, clustering of data and features learning. This is a good strategy for producing generalise features performance. It is also much faster than a network which is trained through back propagation.

Reducing the size of a large neural network to something much smaller and manageable is another problem for new researchers. In case of NLP, the only text has been considered for computing results, why not to produce such a model which can handle text, audio, video and images at the same time to produce probabilistic results.

Another research area includes for the optimisations of algorithms that are more Bayesian (rather than based on a single point estimate of the best parameters), that use more non-differentiable operations.

Automatic Machine Translation, for example, conversion of one language text into another language. Simple automatic translation of the text. Google has recently introduced such a technology using DL concepts. A device reads the text from your images and help out to save time. For example, if you are adding your credit card information for payment, just place your card in hand. Your credit card number will be read by a scanner and will be placed in the required field.

Generation of new handwriting and signature, The writing is provided as a sequence of coordinates used by a pen when the handwriting samples were created. From this corpus, the relationship between the pen movement and the letters is learned, and new examples can be generated ad hoc.

The automatic caption of images, for example, a man holding a pen & paper, then train such a model which gives caption. “That man is going to write a something on paper”. He is not going put pen in pocket and making an aeroplane of paper to fly over his head. Similarly, automatic conversion of the sketch into image or painting is another hot topic.

deep learning research ideas

What is the difference between Deep Learning and Machine Learning:

ML is type of Artificial Intelligence, while Deep learning is sub field of machine learning. It is concerned with the algorithms related to human brains functionality and their structure.  It is a very significant neural network which needs much more data and computational power to extract results. This is a field is related to provide such artificial networks where human thoughts involve. DL works more narrowly on ML techniques and its algorithms to provide more optimise results of real world problems.

Deep learning methods aim at learning feature hierarchies with features from higher levels of the hierarchy formed by the composition of lower level features. Automatically learning features at multiple levels of abstraction allow a system to learn complex functions mapping the input to the output directly from data, without depending entirely on human-crafted features.

What are the limitations of DL:

  1. The biggest problem with DL is to have huge amount of data for better results
  2. Deep networks require massive computational power and resources
  3. Add reasoning capabilities to learning ones
  4. Time consuming
  5. Representation and Generalization
Related Items: research
Share
Tweet
Share
Email

Recommended for you

  • how to write a review paperhow to write a review paper

    How to Write a Review Paper: A Complete Guide
  • how to write survey paperhow to write survey paper

    How to Write a Survey Paper : A Complete Study
  • Issues Emerging in Power electronics and Energy Storage TechnologiesIssues Emerging in Power electronics and Energy Storage Technologies

    Issues Emerging in Power electronics and Energy Storage Technologies

Most Popular

motivation lettermotivation letter

4.6K

P.h.D

PhD Motivation Letter Examples: A Sample and Complete Guide

acceptance letter from Chinese supervisoracceptance letter from Chinese supervisor

3.6K

P.h.D

Tips for How to Get Acceptance Letter from Chinese Professor

phd proposal sample format computer sciencephd proposal sample format computer science

2.0K

Research

How to write a P.h.D proposal in Computer Science A Complete Guide

Sample Email to Professors in Chinese UniversitiesSample Email to Professors in Chinese Universities

1.6K

P.h.D

Sample Email to Professors in Chinese Universities

machine learning thesis topics for ms studentsmachine learning thesis topics for ms students

1.3K

Research

What are Good Topics in Machine Learning for Master Thesis in Computer Science

Good Research Paper Topics about Human BehaviorGood Research Paper Topics about Human Behavior

961

Research

Good Research Paper Topics about Human Behavior

896

Resume

Resume vs. CV:Guide on Header,Font Size and Reference page and Format with Examples

recommendation letter from professorrecommendation letter from professor

883

Research

Letter of Recommendation for P.h.D  MS Admission From Professors to Get Scholarships

825

Research

Different Parts of a Research Paper

What are Good Topics in Machine Learning for Master Thesis in Computer Science

How to Cite a Book APA – Citing Book Chapter in APA – Format  Example


To Top