4.0.0 roadmap

[lfcnassif]

All devs,

I've just created a kanban board to track the progress of 4.0.0 here: https://github.com/sepinf-inc/IPED/projects/1

Let me know if you want to include something in the roadmap or if something included is low priority and could be removed.

[lfcnassif]

All devs,

The current 4.0.0 roadmap is this: https://github.com/sepinf-inc/IPED/projects/1

I almost decided to reschedule #24 and #23 (and maybe #667) to 4.1.0, they would need weeks, maybe 1-2 months... but to implement #1062 (their required breaking change) for 4.0.0, I think it would need just a one week effort. So possibly we could release a 4.0.0-BETA in early May. 4.0.0 has many many important features already finished months ago and I would like to release them, after finishing the breaking changes.

So, do you all agree with this scheduling change?

[wladimirleite]

It seems a good idea to me!
To be honest, I am kind of anxious to see version 4 released (and a bit worried, as it contains many changes).

[lfcnassif]

#24 and #23 were 4.0.0 primary goals since the beginning, I'm a bit frustrated about rescheduling them, but as they would still need many weeks (I didn't start working on them, except the finished #538), I think it is better to just implement their basic requirements and release all finished features...

[lfcnassif]

Given the +2 for rescheduling and -0 for not, I'll do.

[lfcnassif]

All,

Finally, we finished the 4.0.0 roadmap, thanks all contributors! I'm thinking about enabling FaceRecognition for pedo profile by default. If dependencies are not installed/configured, the module is disabled, a warning is printed in console, like other features, and processing continues. Any objections?

[aberenguel]

I'm having an issue with FaceRecognitionTask. It is increasing the process time too much.

[lfcnassif]

Was some error printed in console or in the log? Is this happening just with this case or any? What is your OS? Are those files images rendered fine? I guess some issue happened when starting external python process, since the task doesn't seem to have processed any file (0%), there are python processes running? Are they restarted often or they are kinda permanent?

[aberenguel]

Was some error printed in console or in the log?

Caught several traces like that in the log

2022-06-29 17:50:40	[WARN]	[engine.task.PythonTask]			Exception from FaceRecognitionTask.py on /Item01-SSD-Seagate.E01/vol_vol2/Recovery/WindowsRE/Winre.wim>>Carved-134611539.png: jep.JepException: <class 'FileNotFoundError'>: 2
jep.JepException: <class 'FileNotFoundError'>: 2
	at /usr/lib/python3.10/subprocess._execute_child(subprocess.py:1842) ~[?:?]
	at /usr/lib/python3.10/subprocess.__init__(subprocess.py:966) ~[?:?]
	at /home/berenguel/git/IPED/target/release/iped-4.0.0-beta/conf/scripts/FaceRecognitionTask.createExternalProcess(FaceRecognitionTask.py:68) ~[?:?]
	at /home/berenguel/git/IPED/target/release/iped-4.0.0-beta/conf/scripts/FaceRecognitionTask.process(FaceRecognitionTask.py:232) ~[?:?]
	at jep.Jep.invoke(Native Method) ~[jep-4.0.3.jar:?]
	at jep.Jep.invoke(Jep.java:257) ~[jep-4.0.3.jar:?]
	at iped.engine.task.PythonTask.process(PythonTask.java:310) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processMonitorTimeout(AbstractTask.java:250) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:180) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.PythonTask.sendToNextTask(PythonTask.java:273) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.sendToNextTask(AbstractTask.java:207) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.task.AbstractTask.processAndSendToNextTask(AbstractTask.java:188) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.core.Worker.process(Worker.java:177) [iped-engine-4.0.0-beta.jar:?]
	at iped.engine.core.Worker.run(Worker.java:266) [iped-engine-4.0.0-beta.jar:?]

Is this happening just with this case or any?

This is the first case I'm processing using pedo profile using 4.0.0-beta (FaceRecognition enable by default)))))))))))))).

What is your OS?

Ubuntu 22.04

Are those files images rendered fine? I guess some issue happened when starting external python process, since the task doesn't seem to have processed any file (0%), there are python processes running? Are they restarted often or they are kinda permanent?

I cancelled the process. So I did not see the opened case. Maybe the stack trace above could explain. If you want I can make some experiments.

[aberenguel]

Sorry for reporting this issue here. I think It deserves an issue.

[aberenguel]

The problem is that in Ubuntu the python command does not exist by default.
There are python3 and python2. So I had to install

sudo apt install python-is-python3

[lfcnassif]

Oh ok... @arisjr reported it informally before, but hasn't opened an issue, then I forgot to fix before 4.0-beta. Please open an issue so I won't forget again, I'll be able to fix it just on next Tuesday.