Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
222 commits
Select commit Hold shift + click to select a range
4b2b7a4
fix patch extraction under the robot
kvsikand Nov 30, 2021
40b4168
fix future projection
kvsikand Nov 30, 2021
bdd7e14
start on batching up processing for handling large bag files
kvsikand Dec 2, 2021
64fbe53
fix batching logic
kvsikand Dec 2, 2021
3e4f279
attempt to update train script
kvsikand Dec 6, 2021
1a7c9cc
minor fixes
kvsikand Dec 6, 2021
a1e26ca
better patch selection
kvsikand Dec 6, 2021
3a6b991
running on robofleet
Dec 6, 2021
d0b6641
Merge branch 'kavan/patch-extraction-fix' of github.com:HareshKarnan/…
Dec 6, 2021
ba61cc1
remove vis
Dec 7, 2021
2ca3f20
using threading to save the data
HareshKarnan Dec 7, 2021
dc5c573
using threading to save the data
HareshKarnan Dec 7, 2021
6dcf7ad
fixed merge conflicts
HareshKarnan Dec 7, 2021
0cd2525
fixed the bug with batch_idx when saving the pickle file
HareshKarnan Dec 7, 2021
df2cfde
using 2 different IKD models for visual and non-visual
HareshKarnan Dec 14, 2021
57b8350
moved arguments into a separate python scriot
HareshKarnan Dec 14, 2021
0144202
removed .pyc fiule
HareshKarnan Dec 14, 2021
9c35834
updates to training data creation
Dec 16, 2021
3780998
Merge branch 'kavan/patch-extraction-fix' of github.com:HareshKarnan/…
Dec 16, 2021
2d42f8a
added a ikd non-visual node
HareshKarnan Dec 16, 2021
c0e4739
merged with kavan's recent commit
HareshKarnan Dec 16, 2021
b729620
updated the imu_ikd_node
HareshKarnan Dec 17, 2021
96a7a07
fixing some bugsss
HareshKarnan Dec 17, 2021
2c3a5fe
updated code to perform pickling after recording all data, while not …
HareshKarnan Dec 18, 2021
fb4f3c0
testing trained model on the alphatruck
HareshKarnan Dec 20, 2021
d36e933
fixed history size at 5
HareshKarnan Dec 20, 2021
2e7b294
fixed model loading error in imu_ikd_node
HareshKarnan Dec 20, 2021
2448d28
fixed bug in imu_ikd_node
HareshKarnan Dec 20, 2021
b4d3e40
fixed bug move accel,gyro,odom to GPU before inference
HareshKarnan Dec 20, 2021
61fb175
sending zero vel when robot is asked to be static
HareshKarnan Dec 20, 2021
33af9bb
sending zero vel when robot is asked to be static
HareshKarnan Dec 20, 2021
9818605
sending zero vel when robot is asked to be static
HareshKarnan Dec 20, 2021
60f0be1
attempt at create triplets
Dec 20, 2021
8090c36
more arguments
Dec 20, 2021
1aec244
Merge branch 'kavan/patch-extraction-fix' of github.com:HareshKarnan/…
Dec 20, 2021
29e7c35
pushing latest fixes
HareshKarnan Dec 21, 2021
04c6972
resolved merge conflicts with the bash scripts
HareshKarnan Dec 21, 2021
53836db
progress towards triplets
Dec 21, 2021
f7cc1c6
trying out a resnet8 model
HareshKarnan Dec 21, 2021
9c08d68
Merge branch 'kavan/patch-extraction-fix' of github.com:HareshKarnan/…
HareshKarnan Dec 21, 2021
e903a48
commented kavan's patch lines
HareshKarnan Dec 21, 2021
8d1e33e
fixed bug in train.py
HareshKarnan Dec 21, 2021
848bae7
fixed bug in train.py
HareshKarnan Dec 21, 2021
5508d46
fix path issue
HareshKarnan Dec 21, 2021
0bb7bf9
fix path issue
HareshKarnan Dec 21, 2021
b0d9ecf
resnet8 model works now
HareshKarnan Dec 21, 2021
e5551ea
using ddp accelerator
HareshKarnan Dec 21, 2021
bd19bf3
not use vision by default
HareshKarnan Dec 22, 2021
385c06d
added dropout
HareshKarnan Dec 22, 2021
8ce6317
removed dropout
HareshKarnan Dec 22, 2021
44aaede
added dropout
HareshKarnan Dec 22, 2021
6757195
writing code for vision based ikd node on the robot
HareshKarnan Dec 23, 2021
046593b
not printing zero commands to stdout
HareshKarnan Dec 23, 2021
8dc6e0a
fixed bug in rotational vel
HareshKarnan Dec 23, 2021
b36b8a0
fixed bug in rotational vel
HareshKarnan Dec 23, 2021
19b6a7e
fixed bug in rotational vel
HareshKarnan Dec 23, 2021
1d0adc9
fixed bug in rotational vel
HareshKarnan Dec 23, 2021
0f0d1a4
not using ikd model when rotation velocity > 2.0
HareshKarnan Dec 23, 2021
96e601c
not using ikd model when rotation velocity > 2.0
HareshKarnan Dec 23, 2021
23c0889
not using ikd model when rotation velocity > 2.0
HareshKarnan Dec 23, 2021
936401d
not using ikd model when rotation velocity > 2.0
HareshKarnan Dec 23, 2021
08e5474
not using ikd model when rotation velocity > 2.0
HareshKarnan Dec 23, 2021
8129cc4
not using ikd model when rotation velocity > 2.0
HareshKarnan Dec 23, 2021
99b3d44
creating dataset script for dr-light machine
HareshKarnan Dec 25, 2021
b295818
Merge branch 'kavan/patch-extraction-fix' of github.com:HareshKarnan/…
HareshKarnan Dec 25, 2021
3d13097
computing translational velocity correctly from the intel realsense s…
HareshKarnan Dec 25, 2021
ed44a69
setting gpu ids
HareshKarnan Dec 25, 2021
50ec64d
Merge branch 'kavan/patch-extraction-fix' of github.com:HareshKarnan/…
HareshKarnan Dec 25, 2021
a0b2ee3
setting gpu ids
HareshKarnan Dec 25, 2021
e442a90
made the odom trans vel change in imu ikd node
HareshKarnan Dec 25, 2021
dc1d86c
made the odom trans vel change in imu ikd node
HareshKarnan Dec 25, 2021
16c5562
only change the next odom
HareshKarnan Dec 25, 2021
3f12125
only change the next odom
HareshKarnan Dec 25, 2021
b58f198
creating dataset script for dr-light machine
HareshKarnan Dec 25, 2021
a701e09
correct for time delay in rosbags
HareshKarnan Dec 25, 2021
6c85c41
added more training samples
HareshKarnan Dec 25, 2021
3c4f5e2
Merge branch 'kavan/patch-extraction-fix' of github.com:HareshKarnan/…
HareshKarnan Dec 25, 2021
8176ca8
not using sqrt
HareshKarnan Dec 25, 2021
9b237d0
not using sqrt
HareshKarnan Dec 25, 2021
c36678c
if velocity less than 0.5, do what graph nav says
HareshKarnan Dec 26, 2021
58dc1c2
only use ikd node
HareshKarnan Dec 26, 2021
6012bba
added waypoint recorder
HareshKarnan Dec 26, 2021
84d2043
added waypoint recorder
HareshKarnan Dec 26, 2021
bd91381
printing waypoints to screen
HareshKarnan Dec 26, 2021
e792183
printing waypoints to screen
HareshKarnan Dec 26, 2021
6d681ce
added waypoint navigation
HareshKarnan Dec 26, 2021
e27eea4
added waypoint navigation
HareshKarnan Dec 26, 2021
fc6e8d5
added waypoint navigation
HareshKarnan Dec 26, 2021
5b5777d
added waypoint navigation
HareshKarnan Dec 26, 2021
429daa2
added waypoint navigation
HareshKarnan Dec 26, 2021
b86bdab
added waypoint navigation
HareshKarnan Dec 26, 2021
5498466
added waypoint navigation
HareshKarnan Dec 26, 2021
6cea90e
added waypoint navigation
HareshKarnan Dec 26, 2021
4e563ae
using localization msg to record waypoints
HareshKarnan Dec 27, 2021
bd033d2
using localization msg to record waypoints
HareshKarnan Dec 27, 2021
f40bb3f
waypoint navigator updated
HareshKarnan Dec 27, 2021
46b8d3f
waypoint navigator updated
HareshKarnan Dec 27, 2021
632448f
waypoint navigator updated
HareshKarnan Dec 27, 2021
3ce5e24
waypoint navigator updated
HareshKarnan Dec 27, 2021
3fea1f1
waypoint navigator updated
HareshKarnan Dec 27, 2021
5723ad0
waypoint navigator updated
HareshKarnan Dec 27, 2021
98c3556
waypoint navigator updated
HareshKarnan Dec 27, 2021
fb4e069
waypoint navigator updated
HareshKarnan Dec 27, 2021
599e83f
waypoint navigator updated
HareshKarnan Dec 27, 2021
1833fa8
waypoint navigator updated
HareshKarnan Dec 27, 2021
59c44d3
waypoint navigator updated
HareshKarnan Dec 27, 2021
6a94b04
waypoint navigator updated
HareshKarnan Dec 27, 2021
09e5892
waypoint navigator updated
HareshKarnan Dec 27, 2021
8ced209
waypoint navigator updated
HareshKarnan Dec 27, 2021
a6700ae
waypoint navigator updated
HareshKarnan Dec 27, 2021
af52025
using odom information instead of accel and gyro
HareshKarnan Dec 29, 2021
0299876
included 10,11,12,13 datasets
HareshKarnan Dec 29, 2021
941ac1f
reverting back to using accel and gyro values
HareshKarnan Dec 29, 2021
07674db
reverting back to using accel and gyro values
HareshKarnan Dec 29, 2021
8452fa5
reverting back to using accel and gyro values
HareshKarnan Dec 29, 2021
01a695b
if a patch is not found, we get the patch infront of the robot
HareshKarnan Dec 29, 2021
9e37f66
updated the alphatruck config files
HareshKarnan Dec 29, 2021
b3cb036
fixed a bug in rosbag recorder
HareshKarnan Dec 29, 2021
776348c
using train1-9
HareshKarnan Dec 30, 2021
2755147
odom next is +7 th frame
HareshKarnan Dec 30, 2021
65ce225
odom next is +6 th frame
HareshKarnan Dec 30, 2021
937e4f2
updated the alphatruck config files
HareshKarnan Dec 30, 2021
259a550
updated the alphatruck config files
HareshKarnan Dec 30, 2021
562cf82
pushing initial code for vision_imu_node
HareshKarnan Dec 30, 2021
f69cca7
updated training arguments
HareshKarnan Dec 30, 2021
7768ad5
fixed bug in vision_imu node
HareshKarnan Dec 30, 2021
4419834
fixed bug in vision_imu node
HareshKarnan Dec 30, 2021
26fb656
fixed bug in vision_imu node
HareshKarnan Dec 30, 2021
f3c9921
fixed bug in vision_imu node
HareshKarnan Dec 30, 2021
d3119f6
fixed bug in vision_imu node
HareshKarnan Dec 30, 2021
8343006
fixed bug in vision_imu node
HareshKarnan Dec 30, 2021
c2b23f7
fixed bug in vision_imu node
HareshKarnan Dec 31, 2021
9e8a738
fixed bug in vision_imu node
HareshKarnan Dec 31, 2021
25cde02
fixed bug in vision_imu node
HareshKarnan Dec 31, 2021
64dfb5b
using a smaller model
HareshKarnan Dec 31, 2021
9ccad9f
using a smaller model
HareshKarnan Dec 31, 2021
0eb057b
using a smaller model
HareshKarnan Dec 31, 2021
96f6504
using a smaller model
HareshKarnan Dec 31, 2021
32a9a07
using a smaller model
HareshKarnan Dec 31, 2021
2f087a9
using a smaller model
HareshKarnan Dec 31, 2021
970c0e3
using a smaller model
HareshKarnan Dec 31, 2021
63e25c2
using a smaller model
HareshKarnan Dec 31, 2021
f2b76bb
using a smaller model
HareshKarnan Dec 31, 2021
f988a8f
using a smaller model
HareshKarnan Dec 31, 2021
6c92f8e
using a smaller model
HareshKarnan Dec 31, 2021
6a618e1
using a smaller model
HareshKarnan Dec 31, 2021
58c1efd
using a smaller model
HareshKarnan Dec 31, 2021
b74ba28
using a smaller model
HareshKarnan Dec 31, 2021
58fd316
using a smaller model
HareshKarnan Dec 31, 2021
0065764
using a smaller model
HareshKarnan Dec 31, 2021
187234c
using a smaller model
HareshKarnan Dec 31, 2021
7aa8320
using a smaller model
HareshKarnan Dec 31, 2021
5b68ad5
using a smaller model
HareshKarnan Dec 31, 2021
333bc24
using a smaller model
HareshKarnan Dec 31, 2021
b681123
using a smaller model
HareshKarnan Dec 31, 2021
a83763f
using a smaller model
HareshKarnan Dec 31, 2021
63ea50f
using a smaller model
HareshKarnan Dec 31, 2021
2bb940f
using a smaller model
HareshKarnan Dec 31, 2021
c15396b
using a smaller model
HareshKarnan Dec 31, 2021
474c7af
using a smaller model
HareshKarnan Dec 31, 2021
eab2c4e
using a smaller model
HareshKarnan Dec 31, 2021
de1c4c1
using a smaller model
HareshKarnan Dec 31, 2021
40a40bb
using a smaller model
HareshKarnan Dec 31, 2021
0bab20f
using a smaller model
HareshKarnan Dec 31, 2021
cdecd60
using a smaller model
HareshKarnan Dec 31, 2021
7238043
using a smaller model
HareshKarnan Dec 31, 2021
60a84a7
using a smaller model
HareshKarnan Dec 31, 2021
9f89568
using a smaller model
HareshKarnan Dec 31, 2021
5f60438
using a smaller model
HareshKarnan Dec 31, 2021
7f51ac1
using a smaller model
HareshKarnan Dec 31, 2021
d406564
using a smaller model
HareshKarnan Dec 31, 2021
ff805a0
using a smaller model
HareshKarnan Dec 31, 2021
193ae29
using a smaller model
HareshKarnan Dec 31, 2021
c6d3f33
using a smaller model
HareshKarnan Dec 31, 2021
131da53
using a smaller model
HareshKarnan Dec 31, 2021
c2898da
using a smaller model
HareshKarnan Dec 31, 2021
b8823b2
using a smaller model
HareshKarnan Dec 31, 2021
4071d3b
using a smaller model
HareshKarnan Dec 31, 2021
f3632a2
using a smaller model
HareshKarnan Dec 31, 2021
9038cb8
progress
Jan 5, 2022
c6d6c36
revert model size to fix training
Jan 5, 2022
d406cbb
local changes
HareshKarnan Jan 5, 2022
1fd361c
Merge branch 'kavan/patch-extraction-fix' of github.com:HareshKarnan/…
HareshKarnan Jan 5, 2022
e08a136
pushing latest changes
HareshKarnan Jan 21, 2022
aece820
pushing latest changes
HareshKarnan Jan 21, 2022
b98cac7
updating latest changes. fixed a bug in patch extraction :D
HareshKarnan Jan 24, 2022
03f52c9
changed scaling in offline dataprocessor for the new bevimage
HareshKarnan Jan 24, 2022
626bde6
updated alphatruck config file - tuned the vesc, recollected data in …
HareshKarnan Jan 28, 2022
5e57366
training encoder
HareshKarnan Jan 28, 2022
931858e
updates
HareshKarnan Feb 8, 2022
c0d256c
updated train and val sets
HareshKarnan Feb 8, 2022
3948fa9
updated
HareshKarnan Feb 9, 2022
a1deccf
updated create triplets
HareshKarnan Feb 9, 2022
00da309
running triplet generation
HareshKarnan Feb 9, 2022
c0e286a
pushing code for training experience encoder
HareshKarnan Feb 9, 2022
be7cd80
fixed cuda bug in train experience encoder
HareshKarnan Feb 9, 2022
989c2b5
fixed cuda bug in train experience encoder
HareshKarnan Feb 9, 2022
74af9e9
updated create triplets
HareshKarnan Feb 9, 2022
fbee10b
updated arguments for train.py
HareshKarnan Feb 9, 2022
025a4ce
new data
HareshKarnan Feb 11, 2022
c645600
updated
HareshKarnan Feb 11, 2022
91dd8e5
added more data
HareshKarnan Feb 11, 2022
1a9b046
added more data
HareshKarnan Feb 11, 2022
058c6c2
removed batchnorm
HareshKarnan Feb 11, 2022
c80b4b1
reverting back to using batchnorm
HareshKarnan Feb 11, 2022
9afc31f
using realsense as localizer
HareshKarnan Feb 15, 2022
70c6aa4
outdoor data
HareshKarnan Feb 16, 2022
3552470
pushed some changes
HareshKarnan Feb 16, 2022
9551aee
only using outdoor data
HareshKarnan Feb 16, 2022
bbc1370
training purely on outdoor bags
HareshKarnan Feb 16, 2022
279f7b9
added delay computation while training
HareshKarnan Feb 16, 2022
881ae5f
training indoor models
HareshKarnan Feb 16, 2022
564b62d
not using odom curr
HareshKarnan Feb 17, 2022
a88784d
removed batchnorm, using dropout
HareshKarnan Feb 17, 2022
63d24b0
removed swa and grad clip
HareshKarnan Feb 17, 2022
84abd89
added skip layer
HareshKarnan Feb 17, 2022
5b6ad91
using batchnorm
HareshKarnan Feb 17, 2022
43c1ee7
using batchnorm
HareshKarnan Feb 17, 2022
7c64581
using skip connections, reverting back to dropout
HareshKarnan Feb 17, 2022
ff7c6bd
use outdoor
HareshKarnan Feb 17, 2022
dc63f8b
pushing changes
HareshKarnan Feb 17, 2022
86e3e8b
added waypoints.yaml for indoor expts
HareshKarnan Feb 17, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -2,3 +2,11 @@ data/*
models/*
lightning_logs/*
**/__pycache__/*
.catkin_tools/
.idea/
build/
devel/
logs/
src/rosbag_sync_data_rerecorder/data
graph.png

16 changes: 8 additions & 8 deletions config/alphatruck.yaml
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
normal_speed: 2.0
turbo_speed: 10.0
accel_limit: 6.0
normal_speed: 2.5
turbo_speed: 4.0
accel_limit: 10.0
maxTurnRate: 0.25
commandInterval: 0.05
speed_to_erpm_gain: 4258
speed_to_erpm_gain: -5133
speed_to_erpm_offset: 180.0
erpm_speed_limit: 22000
steering_to_servo_gain: -0.9015
steering_to_servo_gain: -1.8
steering_to_servo_offset: 0.525
servo_min: 0.05
servo_max: 0.95
wheelbase: 0.324
servo_min: 0.0
servo_max: 1.0
wheelbase: 0.480
9 changes: 9 additions & 0 deletions create_vis_ikd_datasets_haresh.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
#!/bin/bash

# run a loop from 1 to 10
for i in {11..11}
do
echo "processing rosbag train$i.bag"
rm /home/users/haresh92/visual_IKD/src/rosbag_sync_data_rerecorder/data/ahg_indoor_bags/train$i_data/*
roslaunch src/rosbag_sync_data_rerecorder/launch/rosbag_data_recorder.launch dataset:=train$i data_base_dir:=/home/users/haresh92/visual_IKD/src/rosbag_sync_data_rerecorder/data/ahg_indoor_bags out_base_dir:=/home/users/haresh92/visual_IKD/src/rosbag_sync_data_rerecorder/data/ahg_indoor_bags
done
9 changes: 9 additions & 0 deletions create_vis_ikd_datasets_haresh_drlight.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
#!/bin/bash

# run a loop from 1 to 10
for i in {1..13}
do
echo "processing rosbag train$i.bag"
rm /home/users/haresh92/visual_IKD/src/rosbag_sync_data_rerecorder/data/ahg_indoor_bags/train$i_data/*
roslaunch src/rosbag_sync_data_rerecorder/launch/rosbag_data_recorder.launch dataset:=train$i data_base_dir:=/home/users/haresh92/visual_IKD/src/rosbag_sync_data_rerecorder/data/ahg_indoor_bags out_base_dir:=/home/users/haresh92/visual_IKD/src/rosbag_sync_data_rerecorder/data/ahg_indoor_bags
done
8 changes: 8 additions & 0 deletions create_vis_ikd_datasets_kavan.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
#!/bin/bash
# run a loop from 1 to 10
for i in {1..9}
do
echo "processing rosbag train${i}.bag"
rm "/robodata/kvsikand/visualIKD/train${i}_data/*"
roslaunch src/rosbag_sync_data_rerecorder/launch/rosbag_data_recorder.launch dataset:="train$i" data_base_dir:=/robodata/ut_alphatruck_logs/visualIKD/ out_base_dir:=/robodata/kvsikand/visualIKD/
done
9 changes: 9 additions & 0 deletions create_vis_ikd_datasets_predator.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
#!/bin/bash

# run a loop from 1 to 10
for i in {13..28}
do
echo "processing rosbag train$i.bag"
rm /home/haresh/PycharmProjects/visual_IKD/src/rosbag_sync_data_rerecorder/data/outdoor_bags/train$i_data/*
roslaunch src/rosbag_sync_data_rerecorder/launch/rosbag_data_recorder.launch dataset:=train$i data_base_dir:=/home/haresh/PycharmProjects/visual_IKD/src/rosbag_sync_data_rerecorder/data/outdoor_bags out_base_dir:=/home/haresh/PycharmProjects/visual_IKD/src/rosbag_sync_data_rerecorder/data/outdoor_bags
done
Loading