Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve/extend CLI prompt tools #294

Open
rpreen opened this issue Jul 4, 2024 · 0 comments
Open

Improve/extend CLI prompt tools #294

rpreen opened this issue Jul 4, 2024 · 0 comments

Comments

@rpreen
Copy link
Contributor

rpreen commented Jul 4, 2024

As of 1.2.0 the CLI prompt tools were added:

  • $ aisdc gen-attack tool that produces the attack config attack.yaml for running attacks on the CLI
  • $ aisdc gen-target tool that produces the directory target_dir/ that contains a target.yaml and model/data files for running attacks on the CLI
  • subsequently running $ aisdc run target_dir/ attack.yaml executes the attacks and generates a report

These tools need to be improved and extended to provide a better user experience, such as more graceful exiting, and support for different scenarios when the model was not trained in Python, and where the data may be large and not able to be copied and also to handle various preprocessing situations. It seems likely that the aisdc/attacks/target.py will also need to be modified and an aisdc/attacks/model.py may need to be created to wrap target models to encapsulate non-scikit-learn models with fit(), predict() etc. functions that the attacks can assume exists.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant