@Kessie Seconding this. We have a triple tracking Starling 2. Initially, when on SDK 1.3.5, QVIO was barely sufficient for ensure stable flight without drift in conditions that were a bit too bright or dark. We upgraded to SDK 1.4.0 to use OpenVINS and had better luck in our lab, with the quality and features metric as reference that it will have accurate positioning estimates. But as soon as we brought it out to a different test area that is well lit with artificial lighting, it seems like OpenVINS momentarily stalls as soon as the drone is armed (see below pic). Even after letting OpenVINS recover, the height will drift very drastically even when the drone is still on the ground (see below pic). We tried a combination of single, double and triple camera setup. en_vio_always_on doesnt seem to make a difference regardless if its true or false. When we do have to leave the drone on the ground, we manage the temperature by having a dedicated fan pointed at the processor until it is ready to fly.

For now, we have resorted to going back to a single camera QVIO setup

@Moderator When you mentioned different WiFi adapters, do you mean that the Starling 2 is able to support newer WiFi adapters that are WiFi 6E capable too? Or only those that are listed here?

Hi! I'm exploring a way to control a group of Starling 2 as part of a swarming project. One of the ways that I'm looking at doing this is by using IBSS. When I queried the driver for the USB WiFi, it says that IBSS mode is supported (pic below). However, I'm unable to get 2 drones to ping each other. I think I found the github repo for the driver that the Starling 2 uses but it doesn't explicitly says it supports IBSS.

Is there a way to enable this function in the Starling 2? Else, is there a way to upgrade the USB WiFi to something more recent? As far as I know, that might be a problem too as the kernel is pretty old and doesn't support the newer WiFi drivers that are on the newer kernels

Thanks!

@Andrew-Jue Hi! Could you share how you managed to get your VOXL2 working with motion capture? Did you also use Starling 2 or just a VOXL2 on another platform? It looks like I ran into the same problems as you while trying to get my Starling 2 (also using VOXL2) to position hold with an Optitrack setup

I tried following your troubleshooting steps and replicating your params exactly, and while it seems like it can be toggled into position hold, it doesn't hold its position at all. It just kinda flies off away as soon as I switch it into position hold. I did a screen recording of the outputs of /mavros/vision_pose/pose and /mavros/local_position/pose during flight and noticed that the values for these topics diverges and converges seemingly randomly

Before flight (Left: /mavros/vision_pose/pose, Right: /mavros/local_position/pose)

During pos hold (Left: /mavros/vision_pose/pose, Right: /mavros/local_position/pose)

I reviewed the flight logs and it does look like something is commanding it to move away from its position for some reason.

My theory is that the usb wifi on the Starling2 might be introducing some latency that is causing it to fly erratically, although the visual odometry latency seems fine (I think)

Do you have any hints as to what the problem might be?

These are the changes I made to switch the Starling 2 to receive data from the Optitrack system:

• In /etc/modalai/voxl-vision-hub.conf, changed en_vio to false

{
	"config_file_version":	1,
	"en_localhost_mavlink_udp":	true,
	"localhost_udp_port_number":	14551,
	"en_vio":	false,
	"vio_pipe":	"qvio",
	"secondary_vio_pipe":	"ov",
	"vfc_vio_pipe":	"ov",
	"en_reset_vio_if_initialized_inverted":	true,
	"vio_warmup_s":	3,
	"send_odom_while_failed":	true,
	"horizon_cal_tolerance":	0.5,
	"en_hitl":	false,
	"offboard_mode":	"off",
	"follow_tag_id":	0,
	"figure_eight_move_home":	true,
	"robot_radius":	0.300000011920929,
	"collision_sampling_dt":	0.1,
	"max_lookahead_distance":	1,
	"backtrack_seconds":	60,
	"backtrack_rc_chan":	8,
	"backtrack_rc_thresh":	1500,
	"wps_move_home":	true,
	"wps_stride":	0,
	"wps_timeout":	0,
	"wps_damp":	1,
	"wps_vfc_mission":	true,
	"en_tag_fixed_frame":	false,
	"fixed_frame_filter_len":	5,
	"en_transform_mavlink_pos_setpoints_from_fixed_frame":	false,
	"vfc_rate":	100,
	"vfc_rc_chan_min":	980,
	"vfc_rc_chan_max":	2020,
	"vfc_thrust_ch":	3,
	"vfc_roll_ch":	1,
	"vfc_pitch_ch":	2,
	"vfc_yaw_ch":	4,
	"vfc_submode_ch":	6,
	"vfc_alt_mode_rc_min":	0,
	"vfc_alt_mode_rc_max":	0,
	"vfc_flow_mode_rc_min":	0,
	"vfc_flow_mode_rc_max":	0,
	"vfc_hybrid_flow_mode_rc_min":	0,
	"vfc_hybrid_flow_mode_rc_max":	0,
	"vfc_position_mode_rc_min":	0,
	"vfc_position_mode_rc_max":	2100,
	"vfc_traj_mode_rc_min":	0,
	"vfc_traj_mode_rc_max":	0,
	"vfc_yaw_deadband":	30,
	"vfc_vxy_deadband":	50,
	"vfc_vz_deadband":	150,
	"vfc_min_thrust":	0,
	"vfc_max_thrust":	0.800000011920929,
	"vfc_tilt_max":	0.43599998950958252,
	"vfc_yaw_rate_max":	3,
	"vfc_thrust_hover":	0.5,
	"vfc_vz_max":	1,
	"vfc_kp_z":	5.2899999618530273,
	"vfc_kd_z":	5.9800000190734863,
	"vfc_vxy_max":	3,
	"vfc_kp_xy":	0.63999998569488525,
	"vfc_kd_xy":	2.559999942779541,
	"vfc_kp_z_vio":	5.2899999618530273,
	"vfc_kd_z_vio":	5.9800000190734863,
	"vfc_kp_xy_vio":	3.2400000095367432,
	"vfc_kd_xy_vio":	3.9600000381469727,
	"vfc_w_filt_xy_vio":	10,
	"vfc_vel_ff_factor_vio":	0.899999976158142,
	"vfc_xy_acc_limit_vio":	2.5,
	"vfc_max_z_delta":	3,
	"vfc_att_transition_time":	0.5,
	"vfc_stick_move_threshold":	30,
	"vfc_flow_transition_time":	1,
	"vfc_q_min":	10,
	"vfc_points_min":	7,
	"vfc_en_submode_announcement":	1,
	"vfc_disable_fallback":	false,
	"vfc_traj_csv":	"/data/voxl-vision-hub/traj.csv",
	"en_voa":	true,
	"voa_upper_bound_m":	-0.15000000596046448,
	"voa_lower_bound_m":	0.15000000596046448,
	"voa_voa_memory_s":	1,
	"voa_max_pc_per_fusion":	100,
	"voa_pie_max_dist_m":	20,
	"voa_pie_min_dist_m":	0.25,
	"voa_pie_under_trim_m":	1,
	"voa_pie_threshold":	3,
	"voa_send_rate_hz":	20,
	"voa_pie_slices":	36,
	"voa_pie_bin_depth_m":	0.15000000596046448,
	"voa_inputs":	[{
			"enabled":	true,
			"type":	"point_cloud",
			"input_pipe":	"dfs_point_cloud",
			"frame":	"stereo_l",
			"max_depth":	8,
			"min_depth":	0.300000011920929,
			"cell_size":	0.079999998211860657,
			"threshold":	4,
			"x_fov_deg":	68,
			"y_fov_deg":	56,
			"conf_cutoff":	0
		}, {
			"enabled":	true,
			"type":	"point_cloud",
			"input_pipe":	"stereo_front_pc",
			"frame":	"stereo_front_l",
			"max_depth":	8,
			"min_depth":	0.300000011920929,
			"cell_size":	0.079999998211860657,
			"threshold":	4,
			"x_fov_deg":	68,
			"y_fov_deg":	56,
			"conf_cutoff":	0
		}, {
			"enabled":	true,
			"type":	"point_cloud",
			"input_pipe":	"stereo_rear_pc",
			"frame":	"stereo_rear_l",
			"max_depth":	8,
			"min_depth":	0.300000011920929,
			"cell_size":	0.079999998211860657,
			"threshold":	4,
			"x_fov_deg":	68,
			"y_fov_deg":	56,
			"conf_cutoff":	0
		}, {
			"enabled":	true,
			"type":	"tof",
			"input_pipe":	"tof",
			"frame":	"tof",
			"max_depth":	6,
			"min_depth":	0.15000000596046448,
			"cell_size":	0.079999998211860657,
			"threshold":	3,
			"x_fov_deg":	106.5,
			"y_fov_deg":	85.0999984741211,
			"conf_cutoff":	125
		}, {
			"enabled":	true,
			"type":	"rangefinder",
			"input_pipe":	"rangefinders",
			"frame":	"body",
			"max_depth":	8,
			"min_depth":	0.300000011920929,
			"cell_size":	0.079999998211860657,
			"threshold":	4,
			"x_fov_deg":	68,
			"y_fov_deg":	56,
			"conf_cutoff":	0
		}]
}

• In /etc/modalai/voxl-mavlink-server.conf, changed en_external_ap_timesync to 0

{
	"primary_static_gcs_ip":	"192.168.8.10",
	"secondary_static_gcs_ip":	"192.168.8.11",
	"onboard_port_to_autopilot":	14556,
	"onboard_port_from_autopilot":	14557,
	"gcs_port_to_autopilot":	14558,
	"gcs_port_from_autopilot":	14559,
	"en_external_uart_ap":	false,
	"autopilot_uart_bus":	1,
	"autopilot_uart_baudrate":	921600,
	"autopilot_mission_delay_start":	-1,
	"autopilot_mission_delay_sound":	false,
	"autopilot_mission_notif_dur":	0.1,
	"en_external_ap_timesync":	0,
	"en_external_ap_heartbeat":	1,
	"udp_mtu":	0,
	"gcs_timeout_s":	4.5
}

• In vrpn launch file, remapped vrpn_client_node to mavros/vision_pose/pose with 30Hz update frequency
• Disabled QVIO and ovins
• Changed PX4 params: EKF2_EV_CTRL to 11, EKF2_EV_QMIN to 0

voxl2:/$ px4-param show ekf2_ev*
Symbols: x = used, + = saved, * = unsaved
x   EKF2_EVA_NOISE [292,568] : 0.1000
x   EKF2_EVP_GATE [293,569] : 5.0000
x   EKF2_EVP_NOISE [294,570] : 0.1000
x   EKF2_EVV_GATE [295,571] : 3.0000
x   EKF2_EVV_NOISE [296,572] : 0.1000
x + EKF2_EV_CTRL [297,573] : 11
x   EKF2_EV_DELAY [298,574] : 0.0000
x   EKF2_EV_HGT_TO [299,575] : 5000
x   EKF2_EV_NOISE_MD [300,576] : 0
x   EKF2_EV_POS_TO [301,577] : 1000
x   EKF2_EV_POS_X [302,578] : 0.0000
x   EKF2_EV_POS_Y [303,579] : 0.0000
x   EKF2_EV_POS_Z [304,580] : 0.0000
x   EKF2_EV_QMIN [305,581] : 0

 829/2162 parameters used.

• Launched mavros with ModalAI's mavros launch script

@sssagara said in How to tune OpenVins:

I noticed that at all steps, after voxl-reset-vins command is entered, voxl-inspect-vins will always report as STALLED with quality at -1% upon first arming of the drone. This is usually not a problem as the next arm will usually report favourable quality (99%), features (>20) and Z height estimate (at ~0m on ground). However, after the Docker step, I noticed that there was a much higher chance of the Z height exploding in value immediately after the first arming. We're still exploring if the decrease in OpenVINS reliability here is a result of increased CPU usage or other factors

Since SDK 1.4.2 beta 2 seems to work for us (for the most part) as of now, while we try to identify if its a problem on our end, is there a way to prevent apt upgrade from upgrading to the next beta version?

Hi @Cliff-Wong Scratch whatever I learnt in my previous reply. Just did a flight test a day after I conducted those tests

Between my previous successful flight with OpenVINS the day before and today, with environment and lighting conditions remaining the same and the only exception that I bench tested QVIO (by running voxl-configure-open-vins disable and voxl-configure-qvio enable) and then re-enabling OpenVINS again (by voxl-configure-open-vins enable and voxl-configure-qvio disable) and then power cycling, it seemed to have utterly broken OpenVINS

Where in my previous day's successful flight with OpenVINS, upon arming the drone and voxl-inspect-vins momentarily showing OpenVINS has stalled but recovering successfully after disarming and re-arming again, the position estimation by OpenVINS is still valid enough for position hold. However, after switching to QVIO and back to OpenVINS, after the first arming, the Z height immediately explodes and putting it into position hold will just result in the drone shooting to the sky

I'm not sure if disabling the OpenVINS caused some configuration file to change that made it behave this way. This is even after playing around with params such as en_vio_always_on and is_occluded_on_ground for the downwards facing tracking camera.

I tried logging but a bunch of errors came up midway through the logging process. I do have a screen recording of a subsequent flight of QVIO working well and then immediately switching to OpenVINS where it immediately failed. Do let me know who in the team I can send it to privately to have a look at

Thanks

@Cliff-Wong Hi Cliff, thanks for your reply

We have since upgraded to SDK 1.4.2 beta 2. However, before that, in an effort to understand if the problem is a result of bugs in OpenVINS from an outdated SDK version or our algo (that is in docker containers) somehow messing up the odometry (whether by CPU usage or otherwise), I did a clean install to 1.4.0 before slowly installing other packages in steps and testing its ability to position hold using OpenVINS after each step

The steps along the way are:

• SDK 1.4.0 clean install
• Upgrading to SDK 1.4.2 beta 2
• Installed ROS Melodic
• Installed Docker with 2 running containers
• Installed and run MAVROS

Some params that might affect the position hold reliability are fixed as such:

• EKF2_HGT_REF: Vision
• EKF2_RNG_CTRL: Enabled (Conditional)
• en_vio_always_on: true
• en_ext_feature_tracker: false
• Well-lit lab environment

I noticed that at all steps, after voxl-reset-vins command is entered, voxl-inspect-vins will always report as STALLED with quality at -1% upon first arming of the drone. This is usually not a problem as the next arm will usually report favourable quality (99%), features (>20) and Z height estimate (at ~0m on ground). However, after the Docker step, I noticed that there was a much higher chance of the Z height exploding in value immediately after the first arming. We're still exploring if the decrease in OpenVINS reliability here is a result of increased CPU usage or other factors

Since SDK 1.4.2 beta 2 seems to work for us (for the most part) as of now, while we try to identify if its a problem on our end, is there a way to prevent apt upgrade from upgrading to the next beta version?

On a side note, regarding voxl-logger, I tried logging and replaying using voxl-logger. But I can't seem to playback the log (refer to below pic) as it seems like the command is appending an unnecessary '/'. Is this a bug or am I doing something wrong here?

@Kessie Seconding this. We have a triple tracking Starling 2. Initially, when on SDK 1.3.5, QVIO was barely sufficient for ensure stable flight without drift in conditions that were a bit too bright or dark. We upgraded to SDK 1.4.0 to use OpenVINS and had better luck in our lab, with the quality and features metric as reference that it will have accurate positioning estimates. But as soon as we brought it out to a different test area that is well lit with artificial lighting, it seems like OpenVINS momentarily stalls as soon as the drone is armed (see below pic). Even after letting OpenVINS recover, the height will drift very drastically even when the drone is still on the ground (see below pic). We tried a combination of single, double and triple camera setup. en_vio_always_on doesnt seem to make a difference regardless if its true or false. When we do have to leave the drone on the ground, we manage the temperature by having a dedicated fan pointed at the processor until it is ready to fly.

For now, we have resorted to going back to a single camera QVIO setup

@Alex-Kushleyev Hi Alex! Thanks for your reply! I managed to get a hold of a replacement capacitor and it works now! I used a piece of kapton tape to cover the base of the board to prevent any components from getting snagged in the future. Maybe future iterations of the ESC can include something as a simple covering for it

Hi! After not using my Starling2 for about a week, I noticed that I'm unable to power on the drone. After some troubleshooting, I've narrowed down the problem to a capacitor that seems to have knocked off sometime between my previous successful flight and now (pictures as attached). While I'm waiting for a new ESC to be ordered, can anything be done to it that will allow me to at least do bench testing? Or is the ESC absolutely toasted? The LEDs on the ESCs do not turn on and neither do the motors beep. But it still outputs 1.2V instead of the 5V at the main regulator output

Thanks!