This course is a studio-oriented seminar where students will actively participate in the evolution of the ml5.js open source project. The structure of this course is inspired by initiatives such as the Processing Foundation Fellowship and Google Summer of Code.
This is a research course, which is different structures compared to normal courses. The class offers a structure and resources for your own research, as opposed to a more typical curriculum.
| Details | |
|---|---|
| Meeting Time | Wednesdays 9:30am-12pm every other week, starting 1/31/24 |
| Location | TBD |
| Contact | daniel.shiffman@nyu.edu |
| Office Hours | (see email for calendar link) |
The academic requirement for this class is a documention of your research. The final project for the class is a "research report" documenting and summarizing your work over the form of the semester.
It is expected that the format and style of the project documentation will vary considerably based on the specifics of each unique project in this class! The main requirement is to link to written documentation (in the form of a blog post, webpage, github markdown file added to this repo, or other online platform). Additionally, you should prepare a concise slide presentation for the final class on April 17th. You'll have about 8 minutes to present, followed by approximately 5 minutes for questions and feedback.
Here is a guide to how you might structure your documentation and presentation.
- Briefly describe your project: What it is, its goals, how you approached it, and the impact you anticipate it will have. Keep it within ~200-250 words.
- Explain the motivation behind your project and its objectives.
- Detail how your work aligns with and contributes to the ml5.js project or the broader field of creative media arts.
- Outline the methods and approaches you employed.
- List the tools and technologies you used.
- Discuss any community engagement or user testing undertaken.
- Share challenges encountered.
- Describe the outcome of your project. What form does your final work take?
- Reflect on any new questions or challenges that emerged.
- Share your key takeaways and where you see this project going in the future.
- List and summarize the key references, literature, or projects that informed your work.
- Neeti -
- Anya -
- Xiaozao - Interactive Neural Networks - Documentation
- Tres -
- Andrew -
- Jack -
- Myrah - Slide deck
- Spencer -
- Dror -
- Alan - Enhance the ml5.js website with built-in code editor
- AI Research
- Dror - Context ml5 - an AI powered learning platform that teaches creatives to use ml5
- Andrew -
- Audio
- Tres - Generative Audio in ml5.js - Researching suitable machine learning models for audio generation in the browser
- Spencer -
- Speculative Website Enhancements
- Alan Ren - ml5.js Website Functionality Enhancement and Examples with Built-in Editor - Enhance the ml5.js website and built-in code editor.
- Xiaozao Wang - Interactive Machine Learning for Beginners - Help beginners understand how machine learning works behind the scene through interactive web materials.
- Documentation and Accessibility
- Myrah Sarwar - Increasing Accessibility - Improve readability and accessibility of documentation on the ml5.js website.
- Jack B. Du - Machine Learning Tutorials for Absolute Beginners - Creating beginner-friendly educational materials fostering creative explorations with ml5.js.
- Datasets and Bias
- Neeti - Opinionated - Developing a self-assessment tool to mitigate bias in ml5.js.
- Anya - Ethics of the Datasets - Delving into the datasets supporting a ml5.js model and explore avenues for enhancing the library's documentation.
- Welcome and introductions
- Create a project plan based on the template and add it to the projects directory.
- ml5.js development overview
- ml5.js website overview
- transformers.js guest presentation
- small group meetings and project updates
- progress presentations
- small group discussions and individual meetings
- independent work
- final presentations
- Please read ITP's policy on pass/fail
- You are required to attend all class meetings and submit all weekly assignments and a final project.
- Grading (pass/fail) will be based on a combination of factors:
- Attendance, participation in class discussion, and engagement in other students' projects (30%)
- Quality of assignments (50%)
- Final Project (20%)
Please read and review the ITP/IMA Community Commitments.
Plagiarism is presenting someone else’s work as though it were your own. More specifically, plagiarism is to present as your own: A sequence of words quoted without quotation marks from another writer or a paraphrased passage from another writer’s work or facts, ideas or images composed by someone else.
The core of the educational experience at the Tisch School of the Arts is the creation of original academic and artistic work by students for the critical review of faculty members. It is therefore of the utmost importance that students at all times provide their instructors with an accurate sense of their current abilities and knowledge in order to receive appropriate constructive criticism and advice. Any attempt to evade that essential, transparent transaction between instructor and student through plagiarism or cheating is educationally self-defeating and a grave violation of Tisch School of the Arts community standards. For all the details on plagiarism, please refer to page 10 of the Tisch School of the Arts, Policies and Procedures Handbook, which can be found online at: http://students.tisch.nyu.edu/page/home.html
Please feel free to make suggestions to your instructor about ways in which this class could become more accessible to you. Academic accommodations are available for students with documented disabilities. Please contact the Moses Center for Students with Disabilities at 212 998-4980 for further information. Statement on Counseling and Wellness
Your health and safety are a priority at NYU. If you experience any health or mental health issues during this course, we encourage you to utilize the support services of the 24/7 NYU Wellness Exchange 212-443-9999. Also, all students who may require an academic accommodation due to a qualified disability, physical or mental, please register with the Moses Center 212-998-4980. Please let your instructor know if you need help connecting to these resources.
Tisch School of the Arts to dedicated to providing its students with a learning environment that is rigorous, respectful, supportive and nurturing so that they can engage in the free exchange of ideas and commit themselves fully to the study of their discipline. To that end Tisch is committed to enforcing University policies prohibiting all forms of sexual misconduct as well as discrimination on the basis of sex and gender. Detailed information regarding these policies and the resources that are available to students through the Title IX office can be found by using the following link: Title IX at NYU.