question about run "run_demo.m"

[sophiazy]

when I run the "run_demo.m" ,the following question is:

init sliding window startsinit sliding window done in 2.4115 s
generate proposal startsgenerate proposal list done in 1.06 s
run proposal network starts
run proposal network done in 0.11494 s
read proposal results startsread proposal results done in 0.21835 s
generate localization list starts
generate localization list done in 0.000827 s
run localization results starts
run localization results done in 0.011421 s
read localization results starts
Improper assignment with rectangular empty matrix.

Error in run_demo (line 165)
seg_swin(:,9) = a;

Tried many ways, but still no solution.I would appreciated for some advice,very thanks!

[zhengshou]

seems not results returned from C3D. could you also post your log files from C3D/Caffe?

[sophiazy]

The log file content is:
/scnn-master/demo$ cat demo_extract.log
./pred/loc/feature_extract.sh: line 1: ../../../C3D_overlap_loss/build/tools/extract_image_features.bin: No such file or directory

But the file "extract_image_features.bin" is exist,and I check the the file path that should be no problem ,I don't know how to solve the problem,

[zhengshou]

you should check your directory during execution. did you change to demo directory: cd ./demo/. before running the demo? could you print out your execution path in the mat file right before exec ./pred/loc/feature_extract.sh ?

[sophiazy]

I find a strange problem,as long as I run the "run_demo.m",th file content in the "/demo/pre/loc/demo_list_test_prefix_localization.lst " and "/demo/pre/loc/demo_list_test_uniform16_localization.lst" will be empty,but the file exist.so I think the above problem is relevant this problem

[zhengshou]

are demo_list_test_prefix_proposal.lst and demo_list_test_uniform16_proposal.lst also empty? otherwise localization list is empty is due to your proposal network returns nothing.

[sophiazy]

I may not be state the question clear.
"demo_list_test_prefix_localization.lst" "demo_list_test_uniform16_localization.lst" original is not empty in the source code .
as long as I run the "run_demo.m",th file content in the "/demo/pre/loc/demo_list_test_prefix_localization.lst " and "/demo/pre/loc/demo_list_test_uniform16_localization.lst" will become empty,but the file exist.so I think the above problem is relevant this problem

[zhengshou]

as I mentioned in the above, the localization list is empty is exactly due to the proposal network returns nothing - basically no segment is predicted to likely contain action.

So I was wondering whether demo_list_test_prefix_proposal.lst and demo_list_test_uniform16_proposal.lst are also empty and whether you can run the proposal network successfully.

[sophiazy]

demo_list_test_prefix_proposal.lst and demo_list_test_uniform16_proposal.lst are not empty and generate "/pred/pro/seg_swin.mat" file.
But in seg_swin.mat,the colume 7:11 are all zeros,so I am not sure I run the proposal network successfully.

[zhengshou]

are you testing with the demo video or your own video - probably the model cannot detect any actions in your provided video... but in that case usually are very small confidence score... all zeros are really strange to me...

[sophiazy]

sorrt to be a bothered ,I have another question about the run_demo.m, I don't understand the code in line(122-126):
%.........................................................................................................................................
img = dir( [preddir 'loc/output/'] ); % be careful whether all are jpg
for img_index = 3:size(img,1)
[~,prob(img_index-2,:)] = read_binary_blob([preddir 'pro/output/' img(img_index).name]);
end
seg_swin(:,10) = prob(:,2);
%...........................................................................................................................................
in addition,the content "pred/pro/output/" is also empty.
"pred/pro/output/" should be have what files.

[zhengshou]

so prob is also empty or all zero? prob is the confidence score of being action for each segment.

[sophiazy]

prob are all zeros

[sophiazy]

I read the run_demo.m carefully ,there is no file generate in the /pred/pro/output,so the prob is empty,I don't understand the role of the "/pred/pro/output",I would appreciate for your answer.

[zhengshou]

"/pred/pro/output" is used to store all features extracted by C3D (here confidence score fc8 values). so this indicates your proposal network (at least the feature extraction part) is not running correctly. I would suggest you, just in case that you are not, to get familiar with feature extraction using original C3D.

[sophiazy]

@zhengshou
Thanks. I run a shell in original C3D.and I extract the feature in the output file.
namely,"/original C3D root path/example/c3d_feature_extraction/c3d_sport1m_feature_extraction_frm.sh",
the shell content is below:
...........................................................................................................................................
GLOG_logtosterr=1 ../../build/tools/extract_image_features.bin prototxt/c3d_sport1m_feature_extractor_frm.prototxt conv3d_deepnetA_sport1m_iter_1900000 0 50 1 prototxt/output_list_prefix.txt fc7-1 fc6-1 prob
.............................................................................................................................................
However,in the "/scnn-master/demo/pred/pro/feature_extract.sh",the shell content is below:
.............................................................................................................................................
GLOG_logtosterr=1 ../../../C3D_sample_rate/build/tools/extract_image_features.bin demo_finetuning_feature_extract.prototxt ../../../models/THUMOS14/proposal/snapshot/SCNN_uniform16_binary_iter_30000 0 10 100000 demo_list_test_prefix_proposal.lst prob
..................................................................................................................................................
I think there is no problem in the shell.so I think the problem may come out in the C3D_sample_rate,when I run the "make runtest" the problem is below:

.........................................................................................................................................
[----------] 2 tests from HingeLossLayerTest/1, where TypeParam = double
[ RUN ] HingeLossLayerTest/1.TestGradientCPU
[ OK ] HingeLossLayerTest/1.TestGradientCPU (31 ms)
[ RUN ] HingeLossLayerTest/1.TestGradientGPU
[ OK ] HingeLossLayerTest/1.TestGradientGPU (32 ms)
[----------] 2 tests from HingeLossLayerTest/1 (63 ms total)

[----------] 10 tests from BenchmarkTest
[ RUN ] BenchmarkTest.TestTimerConstructorCPU
[ OK ] BenchmarkTest.TestTimerConstructorCPU (0 ms)
[ RUN ] BenchmarkTest.TestTimerStartCPU
[ OK ] BenchmarkTest.TestTimerStartCPU (0 ms)
[ RUN ] BenchmarkTest.TestTimerMilliSecondsCPU
[ OK ] BenchmarkTest.TestTimerMilliSecondsCPU (300 ms)
[ RUN ] BenchmarkTest.TestTimerConstructorGPU
[ OK ] BenchmarkTest.TestTimerConstructorGPU (0 ms)
[ RUN ] BenchmarkTest.TestTimerSecondsGPU
[ OK ] BenchmarkTest.TestTimerSecondsGPU (301 ms)
[ RUN ] BenchmarkTest.TestTimerMilliSecondsGPU
F0308 09:32:15.140877 8460 test_benchmark.cpp:130] Check failed: timer.MilliSeconds() >= 298 (296.281 vs. 298)
*** Check failure stack trace: ***
@ 0x2ac14332bdbd google::LogMessage::Fail()
@ 0x2ac14332dc5d google::LogMessage::SendToLog()
@ 0x2ac14332b9ac google::LogMessage::Flush()
@ 0x2ac14332e57e google::LogMessageFatal::~LogMessageFatal()
@ 0x4f1212 caffe::BenchmarkTest_TestTimerMilliSecondsGPU_Test::TestBody()
@ 0x54370a testing::internal::HandleExceptionsInMethodIfSupported<>()
@ 0x5389a9 testing::Test::Run()
@ 0x538a87 testing::TestInfo::Run()
@ 0x538bc5 testing::TestCase::Run()
@ 0x538e3d testing::internal::UnitTestImpl::RunAllTests()
@ 0x54328a testing::internal::HandleExceptionsInMethodIfSupported<>()
@ 0x538201 testing::UnitTest::Run()
@ 0x41343d main
@ 0x2ac14588af45 (unknown)
@ 0x418b9e (unknown)
make: *** [runtest] Aborted (core dumped)
..................................................................................................................................................

[zhengshou]

as I mentioned in previous emails with you, we did not modify test units and thus running test units will not pass for sure. as for your question about how to generate list files, please refer to samples in scnn/experiments/THUMOS14/

[Priyanka154]

error occured when example is running

v_BaseballPitch_g01_c01/000103.jpg
v_BaseballPitch_g01_c01/000104.jpg
v_BaseballPitch_g01_c01/000105.jpg
v_BaseballPitch_g01_c01/000106.jpg
v_BaseballPitch_g01_c01/000107.jpg
./c3d_sport1m_feature_extraction_frm.sh: 7: ./c3d_sport1m_feature_extraction_frm.sh: ../../build/tools/extract_image_features.bin: not found

[junaidwahid]

@Priyanka154 did you found the solution ?

[Priyanka154]

@junaidwahid NOT YET,
IF YOU HAVE SOLUTION THN PLEASE GUIDE ME