-- Logs begin at Wed 2022-01-05 13:59:35 UTC, end at Wed 2022-01-05 15:21:22 UTC. -- Jan 05 14:50:32.519345 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 05 14:50:32.529048 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 05 14:50:32.530477 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jan 5 14:50:32 2022] *** Jan 05 14:50:32.530477 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 05 14:50:32.530477 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 05 14:50:32.530477 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: nodename: dv-cinder-master-3-iscsi Jan 05 14:50:32.530477 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: machine: x86_64 Jan 05 14:50:32.530477 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: clock source: unix Jan 05 14:50:32.530477 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: pcre jit disabled Jan 05 14:50:32.530477 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: detected number of CPU cores: 4 Jan 05 14:50:32.530477 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: current working directory: / Jan 05 14:50:32.530477 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: detected binary path: /usr/bin/uwsgi-core Jan 05 14:50:32.530477 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: your processes number limit is 47680 Jan 05 14:50:32.531128 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: your memory page size is 4096 bytes Jan 05 14:50:32.531128 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: detected max file descriptor number: 2048 Jan 05 14:50:32.531128 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: lock engine: pthread robust mutexes Jan 05 14:50:32.531128 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: thunder lock: enabled Jan 05 14:50:32.531128 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 05 14:50:32.531128 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 05 14:50:32.589403 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: Python main interpreter initialized at 0x5632f56979c0 Jan 05 14:50:32.589403 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: python threads support enabled Jan 05 14:50:32.589403 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: your server socket listen backlog is limited to 100 connections Jan 05 14:50:32.589403 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: your mercy for graceful operations on workers is 90 seconds Jan 05 14:50:32.589814 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: mapped 403077 bytes (393 KB) for 2 cores Jan 05 14:50:32.589814 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: *** Operational MODE: preforking *** Jan 05 14:50:32.590086 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: *** uWSGI is running in multiple interpreter mode *** Jan 05 14:50:32.590086 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: spawned uWSGI master process (pid: 113914) Jan 05 14:50:32.590301 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 05 14:50:32.593333 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: spawned uWSGI worker 1 (pid: 113915, cores: 1) Jan 05 14:50:32.593333 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: spawned uWSGI worker 2 (pid: 113916, cores: 1) Jan 05 14:50:32.593333 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 05 14:50:34.353378 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 14:50:34.353378 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: from cryptography.utils import int_from_bytes Jan 05 14:50:34.354070 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 14:50:34.354070 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: from cryptography.utils import int_from_bytes Jan 05 14:50:34.354505 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 14:50:34.354505 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: from cryptography.utils import int_from_bytes Jan 05 14:50:34.354646 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 14:50:34.354646 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: from cryptography.utils import int_from_bytes Jan 05 14:50:36.907423 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 05 14:50:36.908578 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 05 14:50:36.908919 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 05 14:50:36.909137 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 05 14:50:36.909226 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 05 14:50:36.909306 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 05 14:50:36.909383 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 05 14:50:36.909475 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 05 14:50:36.909578 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 05 14:50:36.909659 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 05 14:50:36.909746 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.909827 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.910032 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.910150 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.910353 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.910477 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.910672 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.910799 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.911000 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.911130 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.911309 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.911447 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.911632 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.911772 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.911952 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.912095 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.912285 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.912427 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.912621 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.912751 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.912843 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.912998 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.913179 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.913352 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.913504 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.913680 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.913811 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.913990 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.914119 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.914309 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.914421 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.914633 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.914741 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.914938 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.915056 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.915262 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.915349 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.915579 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.915858 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.916093 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.916303 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.916427 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.916612 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.916723 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.916924 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.917043 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.917333 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.917524 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.917655 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.917741 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.917970 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.918060 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.918293 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.918385 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.918602 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.918722 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.918924 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.919016 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.919237 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.919322 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.919631 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.919725 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.919948 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.920039 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.920259 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.920358 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.920575 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.920659 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.920985 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.921100 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.921321 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.921467 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.921630 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.921717 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.921949 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.922042 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.922273 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.922357 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.922581 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.922671 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.922908 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.923010 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.923258 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.923350 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.923583 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.923669 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.923902 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.923987 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.924205 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.924290 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.924516 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.924626 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.924826 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.924914 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.925167 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.925271 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.925474 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.925560 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.925781 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.925874 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.926031 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.926116 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.926342 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.926426 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.926664 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.926750 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.926988 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.927073 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.927312 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.927455 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.927583 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.927667 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.927808 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.927893 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.928127 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.928215 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.928448 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.928540 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.928759 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.928852 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.929082 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.929171 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.929404 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.929500 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.929714 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.929798 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.930022 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.930114 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.930331 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.930425 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.930638 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.930735 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.930945 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.931037 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.931261 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.931347 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.931576 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.931672 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.931897 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.931984 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.932208 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.932292 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.932527 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.932620 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.932922 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.933050 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.933196 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.933289 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.933507 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.933609 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.933846 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.933944 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.934162 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.934247 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.934471 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.934566 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.934793 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.934885 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.935119 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.935206 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.935427 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.935523 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.935732 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.935825 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.936040 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.936134 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.936358 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.936445 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.936689 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.936783 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.936995 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.937115 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.937274 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.937362 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.937576 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.937666 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.937881 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.937979 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.938198 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.938284 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.938504 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.938595 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.939192 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.939308 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.939308 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.939454 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.939454 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.939642 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.939755 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.939855 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.940053 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.940199 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.940379 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.940643 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.940737 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.940981 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.941209 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.941311 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.941622 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.941779 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.941932 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.942245 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.942348 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.942564 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.942884 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.942956 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.943190 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.943468 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.943731 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.943810 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.944031 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.944239 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.944377 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.944631 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.944762 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.944977 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.945272 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.945492 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.945717 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.945935 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.946156 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.946367 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.946596 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.946824 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.946998 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.947132 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.947262 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.947400 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.947400 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.947651 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.947789 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.947918 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.947918 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.948059 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.948199 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.948275 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.948505 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.948580 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.948812 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.948886 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.949202 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.949341 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.949504 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.949712 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.949930 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.950145 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.950145 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.950562 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.950776 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.950990 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.951204 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.951425 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.951639 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.951876 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.952091 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.952236 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.952366 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.952503 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.952633 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.952778 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.952925 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.953129 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.953129 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.953402 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.954076 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.954160 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.954228 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.954291 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.954355 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.954907 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.954977 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.955050 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.955116 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.955179 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.955243 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.955306 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.955388 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.955456 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.955520 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.955619 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.955720 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:36.955932 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.956064 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.956246 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.956401 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.956773 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.956922 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.957056 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.957236 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.957367 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.957496 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.957577 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.957732 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.957957 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.958056 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.958278 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.958375 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.958621 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.958767 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.958912 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.959043 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.959228 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.959370 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.959548 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.959680 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.959904 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.960051 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.960183 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.960315 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.960483 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.960614 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.960808 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.960954 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.961142 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.961277 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.961486 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.961622 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.961822 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.961954 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.962135 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.962264 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.962454 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.962582 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.962765 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.962901 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.963093 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.963224 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.963406 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.963536 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.963734 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.963830 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.964046 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.964181 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.964380 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.964519 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.964695 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.964850 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.965009 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.965159 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.965357 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.965506 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.965677 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.965815 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.965994 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.966088 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.966304 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.966388 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.966613 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.966749 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.966919 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.967056 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.967229 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.967368 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.967537 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.967670 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.967859 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.967989 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.968187 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.968318 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.968494 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.968625 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.968803 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.968877 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.969136 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.969218 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.969456 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.969595 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.969767 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.969904 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.970183 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.970819 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.970962 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.971098 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.971253 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.971404 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.971548 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.971683 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.971870 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.972006 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.972182 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.972321 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.972491 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.972627 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.972812 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.972953 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.973139 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.973282 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.973448 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.973587 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.973764 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.973920 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.974075 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.974232 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.974370 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.974504 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.974686 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.974818 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.975018 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.975160 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.975330 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.975475 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.975640 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.975775 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.975964 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.976109 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.976281 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.976417 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.976599 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.976688 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.976915 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.977048 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.977263 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.977407 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.977580 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.977727 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.977870 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.978003 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.978181 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.978317 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.978488 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.978617 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.978794 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.978930 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.979099 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.979230 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.979409 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.979547 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.979714 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.979857 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.980019 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.980156 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.980324 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.980462 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.980651 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.980787 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.980957 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.981123 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.981290 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.981449 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.981606 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.981742 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.981913 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.982040 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.982218 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.982365 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.982522 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.982658 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.982846 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.982982 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.983125 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.983260 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.983446 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.983590 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.983763 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.983894 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.984057 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.984192 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.984366 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.984496 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.984676 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.984818 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.985029 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.985239 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.985385 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.985518 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.985901 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.986043 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.986181 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.986313 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.986450 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.986584 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.986726 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.986958 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.987091 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.987226 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.987360 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.987512 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.987648 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.987790 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.987924 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.988058 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.988192 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.988326 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.988465 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.988614 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.988747 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.988881 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.989078 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.989224 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.989419 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.989569 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.989751 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.989887 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.990069 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.990205 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.990384 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.990527 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.990694 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.990836 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.991003 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.991137 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.991311 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.991459 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.991622 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.991755 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.991934 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.992072 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.992245 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.992381 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.992564 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.992705 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.992880 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.993291 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.993487 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.993620 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.993798 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.993930 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.994113 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.994269 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.994409 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.994550 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.994735 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.994870 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.995041 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.995180 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.995356 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.995492 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.995677 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.995820 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.995992 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.996140 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.996304 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.996438 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.996619 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.996756 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.996941 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.997124 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.997270 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.997398 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.997579 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.997719 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.997913 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.998057 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.998219 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.998348 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.998533 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.998650 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.998844 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.998945 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.999162 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.999258 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.999474 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.999569 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.999785 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:36.999874 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.000093 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.000181 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.000403 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.000488 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.000715 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.000802 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.001032 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.001140 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.001386 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.001482 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.001702 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.001792 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.002058 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.002148 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.002375 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.002471 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.002697 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.002784 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.003012 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.003098 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.003320 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.003415 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.003628 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.003716 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.003945 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.004030 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.004257 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.004420 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.004554 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.004696 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.004874 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.005012 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.005228 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.005373 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.005539 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.005674 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.005850 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.005996 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.006165 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.006312 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.006481 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.006616 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.006793 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.006930 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.007106 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.007198 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.007417 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.007555 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.007726 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.007870 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.008037 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.008174 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.008358 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.008489 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.008672 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.008769 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.008982 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.009201 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.009344 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.009481 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.009624 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.009766 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.009922 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.010057 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.010215 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.010352 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.010539 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.010684 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.010849 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.010985 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.011161 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.011297 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.011475 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.011622 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.011780 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.011930 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.012094 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.012241 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.012412 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.012555 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.012739 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.012993 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.013161 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.013349 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.013486 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.013666 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.013799 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.013976 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.014120 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.014293 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.014391 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.014611 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.014745 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.014941 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.015185 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.015321 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.015525 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.015661 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.015847 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.015990 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.016157 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.016291 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.016464 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.016599 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.016754 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.017458 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.017633 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.017737 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.017943 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.018073 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.018249 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.018335 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.018555 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.018649 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.018866 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.018954 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.019173 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.019265 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.019478 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.019573 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.019795 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.019888 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.020108 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.020194 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.020420 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.020519 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.020732 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.020820 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.021050 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.021170 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.021378 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.021463 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.021686 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.021779 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.022000 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.022093 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.022306 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.022400 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.022612 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.022712 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.022918 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.023005 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.023237 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.023329 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.023548 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.023643 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.023875 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.023971 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.024190 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.024277 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.024503 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.024596 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.024815 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.024904 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.025144 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.025235 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.025469 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.025564 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.025775 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.025861 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.026081 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.026168 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.026386 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.026473 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.026697 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.026837 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.027008 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.027146 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.027316 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.027448 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.027635 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.027751 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.027940 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.028047 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.028247 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.028343 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.028557 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.028647 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.028859 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.028955 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.029195 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.029287 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.029505 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.029592 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.029823 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.029923 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.030134 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.030229 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.030439 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.030527 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.030742 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.030837 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.031048 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.031135 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.031358 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.031446 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.031663 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.031758 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.031973 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.032060 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.032277 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.032365 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.033163 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.033262 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.033469 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.033556 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.033774 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.033869 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.034082 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.034179 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.034392 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.034479 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.034722 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.034819 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.035030 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.035126 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.035373 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.035547 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.035680 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.035825 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.035967 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.036104 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.036239 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.036379 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.036551 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.036696 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.036855 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.036991 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.037181 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.037316 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.037493 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.037638 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.037805 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.037934 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.038110 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.038241 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.038413 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.038561 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.038726 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.038868 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.039023 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.039157 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.039321 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.039464 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.039625 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.039769 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.039935 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.040066 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.040242 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.040379 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.040557 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.040685 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.040862 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.041002 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.041238 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.041377 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.041512 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.041647 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.041787 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.041923 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.042087 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.042237 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.042392 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.042528 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.042697 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.042842 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.042992 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.043127 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.043298 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.043441 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.043607 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.043746 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.043934 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.044070 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.044247 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.044383 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.044557 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.044702 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.044853 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.044979 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.045185 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.045276 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.045516 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.045697 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.045834 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.045921 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.046138 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.046225 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.046471 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.046567 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.046786 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.046872 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.047100 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.047185 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.047406 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.047500 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.047710 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.047850 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.048026 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.048111 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.048361 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.048450 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.048674 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.048761 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.048988 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.049093 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.049333 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.049423 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.049641 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.049727 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.049948 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.050033 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.050260 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.050347 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.050571 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.050666 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.050883 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.051134 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.051233 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.051315 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.051494 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.051582 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.051806 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.051907 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.052127 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.052212 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.052441 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.052533 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.052752 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.052845 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.053092 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.053181 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.053399 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.053485 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.053713 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.053810 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.054023 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.054109 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.054330 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.054416 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.054643 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.054737 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.054954 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.055090 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.055258 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.055347 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.055569 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.055658 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.055876 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.055970 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.056187 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.056274 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.056495 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.056595 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.056817 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.056923 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.057164 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.057256 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.057477 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.057565 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.057793 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.057917 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.058103 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.058266 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.058420 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.058507 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.058731 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.058818 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.059072 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.059172 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.059376 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.059473 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.059774 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.059860 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.060085 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.060179 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.060399 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.060484 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.060714 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.060802 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.061023 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.061141 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.061351 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.061439 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.061665 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.061752 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.061991 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.062085 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.062300 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.062387 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.062607 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.062701 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.062913 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.063001 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.063248 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.063335 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.063571 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.063657 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.063910 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.064000 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.064241 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.064328 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.064551 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.064645 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.064860 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.064993 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.065197 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.065356 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.065531 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.065705 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.065843 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.065973 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.066171 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.066301 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.066592 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.066694 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.066911 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.066999 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.067225 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.067315 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.067557 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.067660 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.067869 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.067974 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.068197 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.068298 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.068536 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.068645 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.068836 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.068933 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.069179 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.069272 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.069513 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.069602 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.069834 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.069921 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.070149 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.070236 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.070464 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.070551 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.070788 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.070885 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.071103 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.071190 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.071425 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.071514 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.071737 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.071831 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.072065 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.072153 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.072392 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.072481 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.072714 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.072811 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.073018 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.073133 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.073356 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.073467 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.073662 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.073795 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.073968 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.074112 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.074291 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.074437 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.074597 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.074767 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.074909 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.075083 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.075252 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.075399 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.075549 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.075695 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.075832 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.075999 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.076132 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.076348 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.076485 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.076623 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.076759 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.076916 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.077057 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.077261 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.077435 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.077581 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.077759 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.077898 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.078087 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.078215 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.078392 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.078524 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.078718 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.078851 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.079029 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.079161 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.079334 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.080009 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.080162 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.080331 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.080468 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.080656 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.080831 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.080981 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.081144 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.081317 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.081470 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.081644 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.081800 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.081960 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.082129 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.082270 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.082442 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.082576 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.082774 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.082888 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.083107 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.083235 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.083422 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.083544 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.083738 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.083869 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.084063 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.084203 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.084369 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.084534 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.084673 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.084850 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.084984 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.085211 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.085325 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.085547 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.085650 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.085868 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.085963 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.086192 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.086279 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.086519 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.086612 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.086821 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.086915 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.087126 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.087215 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.087440 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.087526 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.087742 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.087836 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.088048 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.088148 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.088370 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.088460 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.088650 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.088746 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.088954 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.089042 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.089284 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.089383 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.089591 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.089679 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.089916 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.090009 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.090225 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.090320 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.090552 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.090641 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.090864 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.090959 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.091174 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.091260 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.091482 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.091571 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.091789 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.091877 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.092109 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.092195 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.092428 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.092526 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.092753 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.092839 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.093090 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.093192 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.093416 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.093503 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.093735 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.093822 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.094050 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.094143 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.094361 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.094448 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.094679 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.094772 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.094995 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.095134 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.095375 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.095474 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.095700 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.095895 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.096046 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.096225 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.096379 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.096541 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.096680 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.096859 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.097004 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.097197 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.097332 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.097514 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.097647 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.097830 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.097976 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.098163 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.098406 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.098524 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.098739 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.098831 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.099059 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.099150 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.099380 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.099497 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.099702 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.099818 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.100021 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.100125 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.100339 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.100428 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.100656 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.100757 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.100970 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.101057 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.101308 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.101396 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.101623 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.101725 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.101953 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.102040 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.102280 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.102369 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.102584 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.102672 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.102898 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.103000 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.103219 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.103308 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.103534 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.103624 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.103853 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.103940 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.104167 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.104255 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.104482 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.104571 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.104795 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.104882 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.105126 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.105238 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.105437 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.105542 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.105753 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.105860 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.106064 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.106233 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.106378 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.106467 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.106694 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.106790 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.107013 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.107110 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.107323 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.107411 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.107635 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.107725 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.107947 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.108035 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.108264 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.108497 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.108600 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.108776 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.108893 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.109153 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.109253 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.109483 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.109573 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.109810 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.109907 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.110133 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.110222 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.110453 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.110542 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.111301 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.111488 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.111612 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.111814 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.111922 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.112153 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.112250 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.112483 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.112573 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.112816 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.112906 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.113164 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.113268 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.113490 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.113579 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.113799 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.113887 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.114118 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.114208 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.114428 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.114516 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.114744 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.114963 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.115061 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.115338 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.115427 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.115663 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.115850 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.115982 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.116080 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.116293 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.116382 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.116618 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.116705 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.116935 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.117033 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.117324 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.117498 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.117636 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.117853 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.118212 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.118442 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.118548 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.118774 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.118865 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.119104 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.119211 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.119410 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.119497 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.119725 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.119820 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.120038 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.120135 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.120347 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.120443 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.120658 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.120745 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.120979 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.121102 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.121324 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.121437 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.121631 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.121728 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.121938 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.122027 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.122242 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.122329 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.122555 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.122645 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.122862 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.122951 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.123166 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.123254 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.123473 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.123571 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.123778 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.123868 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.124091 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.124179 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.124396 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.124485 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.124703 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.124791 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.125006 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.125125 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.125340 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.125437 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.125645 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.125734 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.125959 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.126060 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.126286 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.126883 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.127152 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.127238 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.127465 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.127553 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.127780 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.127877 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.128090 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.128178 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.128403 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.128490 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.128708 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.128814 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.129022 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.129168 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.129358 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.129447 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.129687 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.129778 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.129998 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.130086 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.130306 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.130529 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.130626 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.130915 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.131016 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.131239 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.131327 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.131555 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.131653 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.131873 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.131986 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.132225 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.132314 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.132544 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.132641 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.132853 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.133110 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.133223 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.133494 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.133594 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.133816 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.133904 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.134131 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.134242 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.134442 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.134539 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.134754 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.134843 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.135088 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.135178 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.135429 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.135583 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.135707 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.135840 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.136024 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.136143 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.136339 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.136441 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.136656 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.136765 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.136973 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.137096 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.137316 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.137419 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.137632 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.137733 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.137946 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.138041 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.138261 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.138350 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.138578 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.138668 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.138887 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.138975 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.139200 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.139309 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.139519 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.139621 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.139846 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.139947 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.140165 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.140253 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.140486 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.140575 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.140801 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.140956 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.141137 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.141230 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.141455 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.141555 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.141773 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.141871 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.142122 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.142210 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.142461 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.142550 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.142780 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.142876 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.143092 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.143180 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.143424 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.143512 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.143740 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.143831 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.144073 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.144169 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.144412 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.144507 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.144742 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.144839 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.145087 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.145176 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.145396 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.145495 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.145702 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.145791 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.146012 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.146240 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.146396 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.146544 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.146690 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.146828 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.146978 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.147119 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.147288 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.147435 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.147613 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.147753 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.147928 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.148066 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.148239 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.148390 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.148533 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.148669 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.148854 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.149016 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.149186 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.149326 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.149500 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.149646 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.149834 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.149973 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.150171 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.150330 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.150470 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.150607 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.150786 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.150925 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.151089 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.151226 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.151398 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.151533 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.151711 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.151860 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.152022 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.152157 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.152335 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.152473 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.152661 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.152802 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.152969 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.153154 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.153297 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.153433 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.153613 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.153761 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.153931 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.154070 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.154230 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.154375 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.154547 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.154689 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.154881 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.155027 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.155204 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.155344 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.155514 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.155653 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.155825 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.155964 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.156139 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.156303 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.156460 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.156558 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.156779 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.156874 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.157115 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.157225 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.157493 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.157589 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.157791 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.157879 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.158113 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.158219 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.158432 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.158521 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.158749 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.158844 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.159071 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.159230 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.159393 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.159491 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.159722 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.159810 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.160037 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.160139 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.160345 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.160435 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.160587 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 05 14:50:37.160676 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.161021 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.161367 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.161718 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.162052 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.162374 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.162696 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.163010 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:37.163258 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 05 14:50:37.184022 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG oslo_db.sqlalchemy.engines [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:50:37.185353 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_db.sqlalchemy.engines [None req-83fe2b6d-b6a3-4f90-9bc8-2790b4d7c29c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:50:37.252172 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.context [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9ee8715e-15f7-4a00-a6ea-b782f272eaf8(cell1) {{(pid=113916) load_cells /opt/stack/nova/nova/context.py:464}} Jan 05 14:50:37.255401 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.context [None req-83fe2b6d-b6a3-4f90-9bc8-2790b4d7c29c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9ee8715e-15f7-4a00-a6ea-b782f272eaf8(cell1) {{(pid=113915) load_cells /opt/stack/nova/nova/context.py:464}} Jan 05 14:50:37.256411 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG oslo_concurrency.lockutils [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:50:37.258052 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG oslo_concurrency.lockutils [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:50:37.258843 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG oslo_concurrency.lockutils [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:50:37.259597 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-83fe2b6d-b6a3-4f90-9bc8-2790b4d7c29c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:50:37.260763 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG oslo_concurrency.lockutils [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113916) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:50:37.261220 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-83fe2b6d-b6a3-4f90-9bc8-2790b4d7c29c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:50:37.262043 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-83fe2b6d-b6a3-4f90-9bc8-2790b4d7c29c None None] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:50:37.263969 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-83fe2b6d-b6a3-4f90-9bc8-2790b4d7c29c None None] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:50:37.271173 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG oslo_db.sqlalchemy.engines [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:50:37.273164 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG oslo_db.sqlalchemy.engines [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:50:37.276430 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_db.sqlalchemy.engines [None req-83fe2b6d-b6a3-4f90-9bc8-2790b4d7c29c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:50:37.278683 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_db.sqlalchemy.engines [None req-83fe2b6d-b6a3-4f90-9bc8-2790b4d7c29c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:50:37.441918 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG oslo_db.sqlalchemy.engines [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:50:37.444675 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_db.sqlalchemy.engines [None req-83fe2b6d-b6a3-4f90-9bc8-2790b4d7c29c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:50:37.841733 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: WARNING keystonemiddleware.auth_token [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 05 14:50:37.849090 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: WARNING keystonemiddleware.auth_token [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 05 14:50:37.894065 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: WARNING keystonemiddleware.auth_token [None req-83fe2b6d-b6a3-4f90-9bc8-2790b4d7c29c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 05 14:50:37.900546 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: WARNING keystonemiddleware.auth_token [None req-83fe2b6d-b6a3-4f90-9bc8-2790b4d7c29c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 05 14:50:38.185004 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: WARNING keystonemiddleware.auth_token [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 05 14:50:38.190274 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: WARNING keystonemiddleware.auth_token [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 05 14:50:38.195443 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5632f56979c0 pid: 113916 (default app) Jan 05 14:50:38.197523 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:50:38.198687 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001754 Jan 05 14:50:38.199090 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Wed Jan 5 14:50:38 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:50:38.237508 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: WARNING keystonemiddleware.auth_token [None req-83fe2b6d-b6a3-4f90-9bc8-2790b4d7c29c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 05 14:50:38.242799 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: WARNING keystonemiddleware.auth_token [None req-83fe2b6d-b6a3-4f90-9bc8-2790b4d7c29c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 05 14:50:38.248352 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5632f56979c0 pid: 113915 (default app) Jan 05 14:52:08.502231 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:52:08.503237 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jan 05 14:52:08.503626 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 930 bytes} [Wed Jan 5 14:52:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 14:52:08.928319 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-c29819b8-48ac-4abd-a860-902c8343d07f admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:52:08.958103 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-c29819b8-48ac-4abd-a860-902c8343d07f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.447459 Jan 05 14:52:08.958758 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1291 bytes} [Wed Jan 5 14:52:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:52:11.450303 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:52:11.451340 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-83a3b8dd-805f-4e04-8992-e26296dba08f None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jan 05 14:52:11.454692 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 930 bytes} [Wed Jan 5 14:52:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:52:11.516787 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-fa80c185-7973-4583-a902-3f2f19a30963 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "name": "cirros256", "ram": 256, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:11.535638 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:52:11.535638 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: warnings.warn(msg) Jan 05 14:52:11.640259 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-fa80c185-7973-4583-a902-3f2f19a30963 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.181946 Jan 05 14:52:11.641009 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Jan 5 14:52:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 14:52:11.877598 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-6d6cffe6-c46e-49fb-88ae-b75bfc951bbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:11.879979 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:52:11.879979 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: warnings.warn(msg) Jan 05 14:52:12.000144 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-6d6cffe6-c46e-49fb-88ae-b75bfc951bbb admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.350075 Jan 05 14:52:12.001958 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1335 bytes} [Wed Jan 5 14:52:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:52:14.471879 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-fa80c185-7973-4583-a902-3f2f19a30963 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:52:14.473555 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-fa80c185-7973-4583-a902-3f2f19a30963 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002133 Jan 05 14:52:14.474368 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 930 bytes} [Wed Jan 5 14:52:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:52:14.595222 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-1a5a555b-1f41-4b38-b92a-3a976f9e15ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "vcpus": 1}} {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:14.614279 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:52:14.614279 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: warnings.warn(msg) Jan 05 14:52:14.696588 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-1a5a555b-1f41-4b38-b92a-3a976f9e15ce admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.213890 Jan 05 14:52:14.697382 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Jan 5 14:52:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 14:52:14.708525 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-aff883d8-d00b-4f78-8553-75d5f2b5bb9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:14.710309 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:52:14.710309 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: warnings.warn(msg) Jan 05 14:52:14.826072 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-aff883d8-d00b-4f78-8553-75d5f2b5bb9b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120992 Jan 05 14:52:14.827027 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1335 bytes} [Wed Jan 5 14:52:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:52:17.290599 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-1a5a555b-1f41-4b38-b92a-3a976f9e15ce admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:52:17.291794 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-1a5a555b-1f41-4b38-b92a-3a976f9e15ce admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jan 05 14:52:17.291794 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 930 bytes} [Wed Jan 5 14:52:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:52:17.355193 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-51e4dfbf-5ae1-4df3-86e4-cfae5690712a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2", "disk": 10, "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G"}} {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:17.429222 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-51e4dfbf-5ae1-4df3-86e4-cfae5690712a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.130986 Jan 05 14:52:17.429760 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Jan 5 14:52:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 14:52:17.441791 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-8da3395f-1abc-4293-a621-98857f108040 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:17.549411 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-8da3395f-1abc-4293-a621-98857f108040 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108616 Jan 05 14:52:17.549411 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1335 bytes} [Wed Jan 5 14:52:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:52:20.054667 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-51e4dfbf-5ae1-4df3-86e4-cfae5690712a admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:52:20.056233 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-51e4dfbf-5ae1-4df3-86e4-cfae5690712a admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002053 Jan 05 14:52:20.056630 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 930 bytes} [Wed Jan 5 14:52:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:52:20.126915 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-ee645f4f-3b73-45a6-b9ef-16a2dac5456e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:20.213946 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-ee645f4f-3b73-45a6-b9ef-16a2dac5456e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.149687 Jan 05 14:52:20.214597 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Jan 5 14:52:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 14:52:20.227273 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-de0f524d-0488-4d9e-91dd-9e79da42779b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:20.310754 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-de0f524d-0488-4d9e-91dd-9e79da42779b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087178 Jan 05 14:52:20.311677 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1335 bytes} [Wed Jan 5 14:52:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:52:22.770331 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-ee645f4f-3b73-45a6-b9ef-16a2dac5456e admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:52:22.771344 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-ee645f4f-3b73-45a6-b9ef-16a2dac5456e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jan 05 14:52:22.771795 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 930 bytes} [Wed Jan 5 14:52:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:52:22.834752 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-81f6259f-c13c-45aa-8b31-48df720c9df3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "ram": 4096, "swap": 0, "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:22.915067 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-81f6259f-c13c-45aa-8b31-48df720c9df3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137259 Jan 05 14:52:22.915755 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Jan 5 14:52:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 14:52:22.927938 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-1373050e-2f64-4b5b-a010-36783a7cb184 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:23.023542 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-1373050e-2f64-4b5b-a010-36783a7cb184 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099092 Jan 05 14:52:23.024214 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1335 bytes} [Wed Jan 5 14:52:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 14:52:25.471851 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-81f6259f-c13c-45aa-8b31-48df720c9df3 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:52:25.473220 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-81f6259f-c13c-45aa-8b31-48df720c9df3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001954 Jan 05 14:52:25.473772 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 930 bytes} [Wed Jan 5 14:52:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:52:25.537377 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-0d44e721-5479-4c42-ac3a-c16a3e00859c admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:52:25.561534 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-0d44e721-5479-4c42-ac3a-c16a3e00859c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080213 Jan 05 14:52:25.562095 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1291 bytes} [Wed Jan 5 14:52:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 14:52:28.498765 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-81f6259f-c13c-45aa-8b31-48df720c9df3 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:52:28.499768 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-81f6259f-c13c-45aa-8b31-48df720c9df3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001957 Jan 05 14:52:28.500165 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 930 bytes} [Wed Jan 5 14:52:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 14:52:28.569482 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-3681c334-18d2-484f-991b-de1744f72bfe admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1"}} {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:28.671731 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-3681c334-18d2-484f-991b-de1744f72bfe admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.165451 Jan 05 14:52:28.672405 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Jan 5 14:52:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 14:52:28.684284 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-4064ab4c-e054-46ec-a915-dba32d7f0324 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:28.771004 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-4064ab4c-e054-46ec-a915-dba32d7f0324 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090380 Jan 05 14:52:28.771591 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1332 bytes} [Wed Jan 5 14:52:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:52:31.234550 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-3681c334-18d2-484f-991b-de1744f72bfe admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:52:31.235689 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-3681c334-18d2-484f-991b-de1744f72bfe admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Jan 05 14:52:31.236171 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 930 bytes} [Wed Jan 5 14:52:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:52:31.293666 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-fddde4ee-b745-491e-bef2-61a21ec34d2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:31.378395 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-fddde4ee-b745-491e-bef2-61a21ec34d2e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.135972 Jan 05 14:52:31.378939 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Jan 5 14:52:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 14:52:31.390829 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-c1a70a52-b530-4bce-8785-7306f63f530d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:31.473554 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-c1a70a52-b530-4bce-8785-7306f63f530d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086349 Jan 05 14:52:31.474287 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1332 bytes} [Wed Jan 5 14:52:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:52:33.927161 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-fddde4ee-b745-491e-bef2-61a21ec34d2e admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:52:33.928094 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-fddde4ee-b745-491e-bef2-61a21ec34d2e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jan 05 14:52:33.928499 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 930 bytes} [Wed Jan 5 14:52:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:52:33.987819 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-0f616b89-9a00-45ad-ab96-9541b539251e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true}} {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:34.062280 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-0f616b89-9a00-45ad-ab96-9541b539251e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.127924 Jan 05 14:52:34.063151 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Jan 5 14:52:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 14:52:34.077996 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-5989c991-f88d-415a-82ac-fae910084ff3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:34.156252 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-5989c991-f88d-415a-82ac-fae910084ff3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082279 Jan 05 14:52:34.157246 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1332 bytes} [Wed Jan 5 14:52:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:52:36.678892 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-0f616b89-9a00-45ad-ab96-9541b539251e admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:52:36.678892 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-0f616b89-9a00-45ad-ab96-9541b539251e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jan 05 14:52:36.679606 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 930 bytes} [Wed Jan 5 14:52:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:52:36.747005 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-b119c06c-af24-474f-9782-38f65c7ac6a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:36.835284 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-b119c06c-af24-474f-9782-38f65c7ac6a1 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.150055 Jan 05 14:52:36.836000 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Jan 5 14:52:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 14:52:36.848934 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-5ac7b8dc-4133-4de7-8ba0-f1753ea15546 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:36.942181 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-5ac7b8dc-4133-4de7-8ba0-f1753ea15546 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097455 Jan 05 14:52:36.942997 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1332 bytes} [Wed Jan 5 14:52:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:52:39.399177 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-b119c06c-af24-474f-9782-38f65c7ac6a1 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:52:39.400261 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-b119c06c-af24-474f-9782-38f65c7ac6a1 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jan 05 14:52:39.400812 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 930 bytes} [Wed Jan 5 14:52:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:52:39.467517 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-c6ec9375-3b12-4616-9280-790afbe78c91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:39.561944 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-c6ec9375-3b12-4616-9280-790afbe78c91 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.154898 Jan 05 14:52:39.563027 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Jan 5 14:52:39 2022] POST /compute/v2.1/flavors => generated 408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 14:52:39.593195 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-143d9403-0ee9-4a0c-be5b-285cd03af06a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:52:39.685488 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-143d9403-0ee9-4a0c-be5b-285cd03af06a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107525 Jan 05 14:52:39.685488 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1332 bytes} [Wed Jan 5 14:52:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:53:00.590474 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-c6ec9375-3b12-4616-9280-790afbe78c91 admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:00.591559 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-c6ec9375-3b12-4616-9280-790afbe78c91 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jan 05 14:53:00.591961 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 930 bytes} [Wed Jan 5 14:53:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:53:00.648642 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-bc4e16b6-448e-45e2-b646-e45d134889bc admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:00.665252 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-bc4e16b6-448e-45e2-b646-e45d134889bc admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067217 Jan 05 14:53:00.665780 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1291 bytes} [Wed Jan 5 14:53:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 14:53:02.331361 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-c6ec9375-3b12-4616-9280-790afbe78c91 admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:02.332357 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-c6ec9375-3b12-4616-9280-790afbe78c91 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jan 05 14:53:02.332762 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Jan 5 14:53:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:53:02.521127 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-1c504f5f-055b-4630-a017-d6223a254e5d admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:02.526556 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.wsgi [None req-1c504f5f-055b-4630-a017-d6223a254e5d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 05 14:53:02.527121 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-1c504f5f-055b-4630-a017-d6223a254e5d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 14:53:02.527921 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-1c504f5f-055b-4630-a017-d6223a254e5d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057801 Jan 05 14:53:02.528426 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Jan 5 14:53:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:02.537507 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-1800a4fd-065b-46ee-90e2-06f2e67bc790 admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:02.558070 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-1800a4fd-065b-46ee-90e2-06f2e67bc790 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023959 Jan 05 14:53:02.558523 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Jan 5 14:53:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 14:53:02.568290 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-8b832cd6-ca70-4269-bf74-b91a7cf3d56b admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:02.589018 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-8b832cd6-ca70-4269-bf74-b91a7cf3d56b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023977 Jan 05 14:53:02.589592 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Jan 5 14:53:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 14:53:02.598878 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-49ea17d1-af77-400f-ba3c-d479559c066d admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:02.604352 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.wsgi [None req-49ea17d1-af77-400f-ba3c-d479559c066d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 05 14:53:02.604902 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-49ea17d1-af77-400f-ba3c-d479559c066d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 14:53:02.605712 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-49ea17d1-af77-400f-ba3c-d479559c066d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010406 Jan 05 14:53:02.606687 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Jan 5 14:53:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 05 14:53:04.125893 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-8b832cd6-ca70-4269-bf74-b91a7cf3d56b admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:04.126944 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-8b832cd6-ca70-4269-bf74-b91a7cf3d56b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jan 05 14:53:04.127341 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Jan 5 14:53:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:53:04.320335 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-f8f24f54-b927-407d-a9ff-b0afbb538edf admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:04.326218 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.wsgi [None req-f8f24f54-b927-407d-a9ff-b0afbb538edf admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 05 14:53:04.326780 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-f8f24f54-b927-407d-a9ff-b0afbb538edf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 14:53:04.327566 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-f8f24f54-b927-407d-a9ff-b0afbb538edf admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060840 Jan 05 14:53:04.328074 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Jan 5 14:53:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:04.337420 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-018f6c23-3d31-4ef7-86a3-00f49fe9481f admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:04.350987 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-018f6c23-3d31-4ef7-86a3-00f49fe9481f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017344 Jan 05 14:53:04.351507 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Jan 5 14:53:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 14:53:04.360999 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-9566cd72-f717-41cd-9c09-bff7a8317ff1 admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:04.375057 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-9566cd72-f717-41cd-9c09-bff7a8317ff1 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017610 Jan 05 14:53:04.375574 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Jan 5 14:53:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 14:53:04.384883 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-a7b62589-94a8-41e5-87b7-0d39f7dd5af7 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:04.391522 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.wsgi [None req-a7b62589-94a8-41e5-87b7-0d39f7dd5af7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 05 14:53:04.392091 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-a7b62589-94a8-41e5-87b7-0d39f7dd5af7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 14:53:04.392874 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-a7b62589-94a8-41e5-87b7-0d39f7dd5af7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011729 Jan 05 14:53:04.393447 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Jan 5 14:53:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 05 14:53:05.934052 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-9566cd72-f717-41cd-9c09-bff7a8317ff1 admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:05.935569 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-9566cd72-f717-41cd-9c09-bff7a8317ff1 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001922 Jan 05 14:53:05.935957 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Jan 5 14:53:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:53:06.123110 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-e8ff5cad-2eaa-4adc-a399-f577c6775269 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:06.128318 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.wsgi [None req-e8ff5cad-2eaa-4adc-a399-f577c6775269 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 05 14:53:06.128871 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-e8ff5cad-2eaa-4adc-a399-f577c6775269 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 14:53:06.129687 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-e8ff5cad-2eaa-4adc-a399-f577c6775269 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.056991 Jan 05 14:53:06.130175 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Jan 5 14:53:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 05 14:53:06.139663 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-852eb3b5-6f03-416b-a81d-4e9bd51112e4 admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:06.152725 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-852eb3b5-6f03-416b-a81d-4e9bd51112e4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017124 Jan 05 14:53:06.153233 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Jan 5 14:53:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 14:53:06.162511 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-ddd5454a-e0f3-4c0b-b527-74e95fa38517 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:06.175908 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-ddd5454a-e0f3-4c0b-b527-74e95fa38517 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017227 Jan 05 14:53:06.176421 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Jan 5 14:53:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 14:53:06.185333 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-127ebcae-8e63-47ac-b2d6-f7153f9abc6f admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:06.190397 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.wsgi [None req-127ebcae-8e63-47ac-b2d6-f7153f9abc6f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 05 14:53:06.190954 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-127ebcae-8e63-47ac-b2d6-f7153f9abc6f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113916) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 14:53:06.191728 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-127ebcae-8e63-47ac-b2d6-f7153f9abc6f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009890 Jan 05 14:53:06.192206 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Jan 5 14:53:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 05 14:53:07.712560 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-ddd5454a-e0f3-4c0b-b527-74e95fa38517 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:07.713640 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-ddd5454a-e0f3-4c0b-b527-74e95fa38517 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jan 05 14:53:07.714036 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Jan 5 14:53:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:53:07.900094 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-046e8210-bed1-4873-83ec-3e150cbed5a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:53:08.022540 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-046e8210-bed1-4873-83ec-3e150cbed5a6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.172569 Jan 05 14:53:08.023072 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Jan 5 14:53:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 14:53:09.535419 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-ddd5454a-e0f3-4c0b-b527-74e95fa38517 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:09.536418 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-ddd5454a-e0f3-4c0b-b527-74e95fa38517 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jan 05 14:53:09.536826 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Jan 5 14:53:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:53:09.723571 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-3c030b02-d31e-4290-9776-96278204be84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:53:09.845370 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-3c030b02-d31e-4290-9776-96278204be84 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.171422 Jan 05 14:53:09.845828 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Jan 5 14:53:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 14:53:11.380253 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-ddd5454a-e0f3-4c0b-b527-74e95fa38517 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:11.381286 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-ddd5454a-e0f3-4c0b-b527-74e95fa38517 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jan 05 14:53:11.381688 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Jan 5 14:53:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:53:11.579689 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-7dea9e4a-816d-4933-a382-2e52271fb063 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:53:11.651097 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-7dea9e4a-816d-4933-a382-2e52271fb063 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.121783 Jan 05 14:53:11.651671 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Jan 5 14:53:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 14:53:13.165686 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-ddd5454a-e0f3-4c0b-b527-74e95fa38517 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:13.166694 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-ddd5454a-e0f3-4c0b-b527-74e95fa38517 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jan 05 14:53:13.167094 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Jan 5 14:53:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:53:13.362314 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-1462c850-3ea2-4434-bbed-163f7b3de527 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:53:13.436791 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-1462c850-3ea2-4434-bbed-163f7b3de527 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.125201 Jan 05 14:53:13.437275 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Jan 5 14:53:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 14:53:14.965587 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-ddd5454a-e0f3-4c0b-b527-74e95fa38517 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:14.966591 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-ddd5454a-e0f3-4c0b-b527-74e95fa38517 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jan 05 14:53:14.966986 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Jan 5 14:53:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:53:15.154336 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-bcc8327e-13a8-4590-bb6e-88197738afe1 admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:53:15.173590 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-bcc8327e-13a8-4590-bb6e-88197738afe1 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069740 Jan 05 14:53:15.174104 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Wed Jan 5 14:53:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 14:54:03.708214 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-ddd5454a-e0f3-4c0b-b527-74e95fa38517 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:54:03.709261 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-ddd5454a-e0f3-4c0b-b527-74e95fa38517 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jan 05 14:54:03.709824 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 930 bytes} [Wed Jan 5 14:54:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:54:03.768103 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-6231048b-6503-4640-8ba6-9f9ba46ded63 admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:54:03.787414 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-6231048b-6503-4640-8ba6-9f9ba46ded63 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071047 Jan 05 14:54:03.787934 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1291 bytes} [Wed Jan 5 14:54:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 14:54:03.809556 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-9fa61ba8-3168-448b-b220-ab967d9fdfc2 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:54:03.817333 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-9fa61ba8-3168-448b-b220-ab967d9fdfc2 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011291 Jan 05 14:54:03.817848 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1282 bytes} [Wed Jan 5 14:54:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 14:54:03.829087 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-7eb6024c-0a3f-4ebd-a826-54cf20c88a75 admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:54:03.836642 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-7eb6024c-0a3f-4ebd-a826-54cf20c88a75 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011055 Jan 05 14:54:03.837177 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1285 bytes} [Wed Jan 5 14:54:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:54:03.848513 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-4d0bb59c-c6ad-421f-b427-2344b37e2f44 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:54:03.856553 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-4d0bb59c-c6ad-421f-b427-2344b37e2f44 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011443 Jan 05 14:54:03.857058 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1285 bytes} [Wed Jan 5 14:54:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 14:54:03.867895 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-2b8dfc9a-4690-40c0-89f0-580430c035aa admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:54:03.875142 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-2b8dfc9a-4690-40c0-89f0-580430c035aa admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010579 Jan 05 14:54:03.875638 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1282 bytes} [Wed Jan 5 14:54:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 14:55:56.918950 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-695e0978-e694-4012-99e9-f246586931a6 tempest-verify_tempest_config-539660547 tempest-verify_tempest_config-539660547-project] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:55:56.920978 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-695e0978-e694-4012-99e9-f246586931a6 tempest-verify_tempest_config-539660547 tempest-verify_tempest_config-539660547-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106920 Jan 05 14:55:56.921538 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 34/69] 10.222.0.30 () {58 vars in 1133 bytes} [Wed Jan 5 14:55:56 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 14:57:28.207214 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-2b8dfc9a-4690-40c0-89f0-580430c035aa admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:57:28.208220 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-2b8dfc9a-4690-40c0-89f0-580430c035aa admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jan 05 14:57:28.208616 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 36/70] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Jan 5 14:57:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:57:28.456405 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-cf17f371-3509-455b-8852-0485027a4f54 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:57:28.457608 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:57:28.457608 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: warnings.warn(msg) Jan 05 14:57:28.459135 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-cf17f371-3509-455b-8852-0485027a4f54 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:57:28.459578 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-cf17f371-3509-455b-8852-0485027a4f54 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:57:28.460401 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-cf17f371-3509-455b-8852-0485027a4f54 admin admin] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:57:28.460828 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-cf17f371-3509-455b-8852-0485027a4f54 admin admin] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:57:28.494145 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-cf17f371-3509-455b-8852-0485027a4f54 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.145194 Jan 05 14:57:28.494694 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 35/71] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Jan 5 14:57:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 14:57:30.036453 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-2b8dfc9a-4690-40c0-89f0-580430c035aa admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:57:30.037487 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-2b8dfc9a-4690-40c0-89f0-580430c035aa admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jan 05 14:57:30.037876 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 37/72] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Jan 5 14:57:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:57:30.229562 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-fc97788c-68fb-4b9a-8775-6a915672c269 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:57:30.231347 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:57:30.231347 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: warnings.warn(msg) Jan 05 14:57:30.233193 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-fc97788c-68fb-4b9a-8775-6a915672c269 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:57:30.233730 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-fc97788c-68fb-4b9a-8775-6a915672c269 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:57:30.234531 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-fc97788c-68fb-4b9a-8775-6a915672c269 admin admin] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:57:30.234957 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-fc97788c-68fb-4b9a-8775-6a915672c269 admin admin] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:57:30.253240 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-fc97788c-68fb-4b9a-8775-6a915672c269 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074095 Jan 05 14:57:30.253705 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 36/73] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Jan 5 14:57:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 14:57:42.207653 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-2b8dfc9a-4690-40c0-89f0-580430c035aa admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:57:42.208646 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-2b8dfc9a-4690-40c0-89f0-580430c035aa admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Jan 05 14:57:42.209033 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 38/74] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Jan 5 14:57:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:57:42.408385 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-dff70941-70ae-492f-9b5b-7ae05b6e5c09 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:57:42.409570 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:57:42.409570 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: warnings.warn(msg) Jan 05 14:57:42.411109 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-dff70941-70ae-492f-9b5b-7ae05b6e5c09 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:57:42.411547 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-dff70941-70ae-492f-9b5b-7ae05b6e5c09 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:57:42.412335 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-dff70941-70ae-492f-9b5b-7ae05b6e5c09 admin admin] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:57:42.412760 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-dff70941-70ae-492f-9b5b-7ae05b6e5c09 admin admin] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:57:42.437009 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-dff70941-70ae-492f-9b5b-7ae05b6e5c09 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079746 Jan 05 14:57:42.437510 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 37/75] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Jan 5 14:57:42 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 14:57:44.003627 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: DEBUG nova.api.openstack.wsgi [None req-2b8dfc9a-4690-40c0-89f0-580430c035aa admin admin] Calling method '>' {{(pid=113916) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:57:44.004918 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: INFO nova.api.openstack.requestlog [None req-2b8dfc9a-4690-40c0-89f0-580430c035aa admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Jan 05 14:57:44.005351 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: [pid: 113916|app: 0|req: 39/76] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Jan 5 14:57:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:57:44.194993 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG nova.api.openstack.wsgi [None req-00a4ba9d-f8f7-435a-955a-fe839780c201 admin admin] Calling method '>' {{(pid=113915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:57:44.196174 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:57:44.196174 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: warnings.warn(msg) Jan 05 14:57:44.197756 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-00a4ba9d-f8f7-435a-955a-fe839780c201 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:57:44.198201 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-00a4ba9d-f8f7-435a-955a-fe839780c201 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:57:44.199024 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-00a4ba9d-f8f7-435a-955a-fe839780c201 admin admin] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:57:44.199452 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: DEBUG oslo_concurrency.lockutils [None req-00a4ba9d-f8f7-435a-955a-fe839780c201 admin admin] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:57:44.220773 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: INFO nova.api.openstack.requestlog [None req-00a4ba9d-f8f7-435a-955a-fe839780c201 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.074764 Jan 05 14:57:44.221274 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: [pid: 113915|app: 0|req: 38/77] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Jan 5 14:57:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 14:58:41.179624 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: Wed Jan 5 14:58:41 2022 - graceful shutdown triggered... Jan 05 14:58:41.180158 dv-cinder-master-3-iscsi devstack@n-api.service[113916]: Gracefully killing worker 2 (pid: 113916)... Jan 05 14:58:41.180603 dv-cinder-master-3-iscsi devstack@n-api.service[113915]: Gracefully killing worker 1 (pid: 113915)... Jan 05 14:58:41.184668 dv-cinder-master-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 05 14:58:42.180782 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: worker 1 buried after 1 seconds Jan 05 14:58:42.181403 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: worker 2 buried after 1 seconds Jan 05 14:58:42.181403 dv-cinder-master-3-iscsi devstack@n-api.service[113914]: goodbye to uWSGI. Jan 05 14:58:42.182996 dv-cinder-master-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 05 14:58:42.183553 dv-cinder-master-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 05 14:58:42.186362 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 05 14:58:42.195475 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 05 14:58:42.197564 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jan 5 14:58:42 2022] *** Jan 05 14:58:42.197564 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 05 14:58:42.197564 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 05 14:58:42.197564 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: nodename: dv-cinder-master-3-iscsi Jan 05 14:58:42.197564 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: machine: x86_64 Jan 05 14:58:42.197564 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: clock source: unix Jan 05 14:58:42.197564 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: pcre jit disabled Jan 05 14:58:42.197564 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: detected number of CPU cores: 4 Jan 05 14:58:42.197564 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: current working directory: / Jan 05 14:58:42.197564 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: detected binary path: /usr/bin/uwsgi-core Jan 05 14:58:42.197564 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: your processes number limit is 47680 Jan 05 14:58:42.198512 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: your memory page size is 4096 bytes Jan 05 14:58:42.198512 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: detected max file descriptor number: 2048 Jan 05 14:58:42.198512 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: lock engine: pthread robust mutexes Jan 05 14:58:42.198512 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: thunder lock: enabled Jan 05 14:58:42.198512 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 05 14:58:42.198512 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 05 14:58:42.250378 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: Python main interpreter initialized at 0x563f0432f9c0 Jan 05 14:58:42.250378 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: python threads support enabled Jan 05 14:58:42.250378 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: your server socket listen backlog is limited to 100 connections Jan 05 14:58:42.250378 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: your mercy for graceful operations on workers is 90 seconds Jan 05 14:58:42.250824 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: mapped 403077 bytes (393 KB) for 2 cores Jan 05 14:58:42.250824 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: *** Operational MODE: preforking *** Jan 05 14:58:42.251079 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: *** uWSGI is running in multiple interpreter mode *** Jan 05 14:58:42.251079 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: spawned uWSGI master process (pid: 128773) Jan 05 14:58:42.251288 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 05 14:58:42.252556 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: spawned uWSGI worker 1 (pid: 128788, cores: 1) Jan 05 14:58:42.252556 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: spawned uWSGI worker 2 (pid: 128789, cores: 1) Jan 05 14:58:42.252556 dv-cinder-master-3-iscsi devstack@n-api.service[128773]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 05 14:58:44.191242 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 14:58:44.191242 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: from cryptography.utils import int_from_bytes Jan 05 14:58:44.191991 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 14:58:44.191991 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: from cryptography.utils import int_from_bytes Jan 05 14:58:44.257913 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 14:58:44.257913 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: from cryptography.utils import int_from_bytes Jan 05 14:58:44.258639 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 14:58:44.258639 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: from cryptography.utils import int_from_bytes Jan 05 14:58:46.597195 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 05 14:58:46.597729 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 05 14:58:46.597965 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 05 14:58:46.598221 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 05 14:58:46.598481 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 05 14:58:46.598874 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.599211 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.599537 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.599860 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.600196 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.600514 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.600841 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.601194 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.601529 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.601794 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.602113 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.602446 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.602774 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.603086 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.603401 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.603722 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.604029 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.604355 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.604666 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.605186 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.607306 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.607306 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.607306 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.607306 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.607643 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.607720 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.608048 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.608356 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.608690 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.608998 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.609470 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.609783 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.610104 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.611011 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.611410 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.611729 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.612047 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.612375 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.612705 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.613020 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.613399 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.613709 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.614035 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.614367 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.614678 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.614990 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.615306 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.615648 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.615942 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.616254 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.616509 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.616825 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.617176 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.617509 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.617835 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.618104 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.618349 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.618669 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.619013 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.619318 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.619636 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.619943 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.620257 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.620567 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.620879 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.621221 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.621532 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.621854 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.622173 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.622497 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.622816 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.623141 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.623542 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.623794 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.624115 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.624458 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.624778 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.625107 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.625434 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.625777 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.626697 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.626697 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.626697 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.627136 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.627320 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.627627 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.627878 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.628287 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.628470 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.628791 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.629127 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.629443 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.629753 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.630057 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.630372 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.630685 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.630996 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.631306 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.631616 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.631925 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.632236 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.632542 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.632849 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.633194 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.633522 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.633834 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.634149 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.634457 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.634779 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.635092 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.635410 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.635711 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.636039 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.636344 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.636653 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.636974 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.637314 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.637625 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.637946 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.638250 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.638558 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.638879 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.639196 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.639601 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.639785 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.640101 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.640406 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.640813 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.641016 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.641939 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.642224 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.642489 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.642814 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.643129 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.643439 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.643748 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.644071 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.644489 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.644746 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.645179 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.645424 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.645760 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.646121 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.646411 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.646727 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.647044 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.647372 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.647687 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.648003 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.648320 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.648644 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.648970 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.649331 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.649658 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.649979 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.652261 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.652261 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.652261 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.652261 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.652261 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.652261 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.652261 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.653360 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.653360 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.653360 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.653796 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.653796 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.654105 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.654425 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.654745 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.655081 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.655399 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.655714 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.656053 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.656381 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.656701 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.657032 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.657906 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.658219 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.658536 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.658844 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.659174 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.659512 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.659821 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.660158 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.660472 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.660786 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.661121 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.661434 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.661752 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.662068 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.662377 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.662861 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.663038 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.663316 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.663638 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.663948 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.664258 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.664578 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.664895 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.665234 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.665554 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.665878 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.667304 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.667304 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.667304 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.667304 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.667898 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.667898 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.668190 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.668398 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 05 14:58:46.668886 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.669034 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 05 14:58:46.669227 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.669227 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.669560 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 05 14:58:46.669706 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.669860 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 05 14:58:46.670006 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.670154 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 05 14:58:46.670305 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.670480 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.670630 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.670780 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.670924 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.671065 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.671207 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.671565 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.671727 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.671884 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.672034 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.672184 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.672337 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.672481 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.672655 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.672805 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.672948 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.673138 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.673307 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.673499 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.673656 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.673800 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.673944 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.674092 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.674250 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.674395 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.674543 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.674687 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.674831 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.675071 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.675222 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.675371 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.675526 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.675786 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.675937 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.676088 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.676240 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.676383 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.676533 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.676677 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.676838 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.676990 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.677174 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.677331 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.677474 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.677629 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.677784 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.677927 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.678069 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.678211 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.678354 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.678503 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.678666 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.678823 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.678977 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.679120 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.679279 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.679423 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.679573 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.679716 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.679866 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.679866 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.680146 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.680146 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.680429 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.680580 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.680731 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.680883 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.681028 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.681028 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.681394 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.681756 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.681908 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.682054 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.682213 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.682365 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.682509 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.682651 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.682794 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.682944 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.683100 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.683261 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.683405 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.683555 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.683698 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.683841 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.683997 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.684150 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.684293 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.684443 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.684596 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.684754 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.684904 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.684904 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.685254 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.685406 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.685557 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.685701 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.685956 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.686116 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.686402 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.686576 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.686724 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.686883 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.687037 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.687183 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.687335 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.687497 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.687641 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.687782 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.687945 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.688096 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.688267 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.688426 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.688580 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.688746 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.688898 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.689048 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.689231 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.689386 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.689531 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.689687 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.689839 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.689990 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.690141 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.690284 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.690436 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.690595 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.690747 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.690897 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.691048 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.691205 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.691356 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.691513 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.691876 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.692038 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.692183 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.692326 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.692484 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.692628 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.692772 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.692913 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.693057 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.693273 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.693439 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.693585 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.693736 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.693879 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.694021 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.694163 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.694315 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.694458 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.694602 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.694744 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.694894 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.695047 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.695271 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.695434 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.695588 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.695731 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.695873 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.696122 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.696283 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.696434 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.696580 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.696731 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.696883 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.697043 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.697222 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.697384 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.697535 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.697686 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.697830 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.697987 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.697987 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.698301 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.698518 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.698686 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.698835 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.698987 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.699138 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.699283 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.699445 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.699590 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.699732 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.699885 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.700028 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.700170 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.700311 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.700461 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.700614 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.700764 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.700917 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.701059 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.701343 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.701519 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.701674 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.702030 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.702184 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.702329 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.702481 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.702625 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.702782 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.702933 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.703084 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.703229 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.703379 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.703534 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.703703 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.703855 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.704518 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.704669 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.704814 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.704814 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.705125 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.705276 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.705420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.705576 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.705727 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.705878 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.706036 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.706304 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.706471 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.706617 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.706767 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.706911 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.707062 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.707207 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.707359 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.707503 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.707503 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.707894 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.708041 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.708256 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.708434 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.708589 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.708743 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.708887 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.709031 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.709228 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.709383 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.709528 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.709671 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.709814 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.709964 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.710122 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.710297 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.710442 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.710593 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.710745 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.710905 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.711057 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.711201 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.711352 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.711504 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.711661 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.711814 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.712073 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.712245 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.712412 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.712571 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.712728 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.712874 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.713031 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.713240 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.713401 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.713564 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.713725 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.713869 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.714020 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.714172 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:58:46.714330 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.714497 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.714652 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.714797 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.714947 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.715109 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.715789 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.715947 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.716093 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.716245 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.716506 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.716669 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.716814 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.716978 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.717170 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.717323 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.717468 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.717634 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.717818 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.717967 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.718112 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.718264 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.718417 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.718572 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.718718 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.718861 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.719035 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.719190 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.719342 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.719530 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.720224 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.720224 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.720516 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.720661 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.720884 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.721041 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.721215 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.721371 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.721527 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.721679 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.721834 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.721986 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.722225 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.722376 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.722519 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.722670 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.722824 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.722979 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.723131 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.723282 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.723426 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.723580 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.723736 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.723882 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.724033 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.724190 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.724346 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.724504 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.724656 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.724809 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.724954 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.725163 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.725358 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.725522 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.725678 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.725822 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.725973 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.726126 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.726283 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.726437 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.726686 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.726837 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.726980 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.727125 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.727267 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.727456 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.727612 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.727767 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.727910 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.728062 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.728219 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.728363 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.728514 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.728664 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.728815 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.728959 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.729145 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.729299 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.729450 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.729614 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.729763 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.729916 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.730074 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.730227 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.730377 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.730529 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.730936 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.731084 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.731243 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.731387 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.731537 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.731694 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.731860 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.732019 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.732164 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.732397 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.732553 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.732698 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.732840 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.732992 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.733184 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.733341 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.733486 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.733629 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.733773 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.733936 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.734087 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.734238 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.734383 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.734538 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.734689 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.734845 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.734988 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.735156 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.735325 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.735478 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.735719 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.735892 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.736063 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.736215 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.736372 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.736536 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.736716 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.736967 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.737168 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.737329 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.737486 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.737638 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.737797 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.737954 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.738116 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.738267 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.738423 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.738576 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.738735 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.738886 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.739035 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.739191 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.739352 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.739511 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.739671 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.739832 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.739990 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.740152 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.740310 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.740640 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.740802 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.740953 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.741127 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.741286 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.741447 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.741609 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.741769 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.741928 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.742091 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.742242 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.742430 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.742430 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.742740 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.742890 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.743047 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.743198 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.743347 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.743511 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.743707 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.743864 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.744022 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.744173 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.744337 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.744498 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.744650 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.744799 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.744959 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.745151 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.745322 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.745532 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.745697 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.745858 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.746018 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.746182 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.746346 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.746346 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.746649 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.746649 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.746963 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.746963 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.747374 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.747374 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.747669 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.747832 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.747983 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.748147 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.748305 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.748464 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.748637 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.748796 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.748946 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.749136 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.749299 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.749450 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.749599 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.749756 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.749907 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.750074 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.750228 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.750378 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.750528 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.750696 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.750885 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.751120 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.751282 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.751434 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.751584 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.751745 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.751906 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.752057 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.752208 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.752365 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.752516 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.752666 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.752840 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.753000 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.753220 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.753375 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.753525 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.753674 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.753833 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.753985 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.754147 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.754299 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.754457 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.754609 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.754768 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.754929 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.755086 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.755243 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.755395 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.755553 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.755717 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.755868 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.756018 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.756173 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.756324 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.756488 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.756648 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.756812 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.756970 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.757142 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.757398 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.757570 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.757730 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.757881 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.758030 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.758224 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.758224 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.758525 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.758677 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.758835 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.759004 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.759169 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.759325 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.759490 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.759643 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.759794 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.759960 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.760117 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.760281 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.760432 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.760584 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.760735 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.760891 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.761052 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.761276 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.761429 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.761578 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.761736 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.761887 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.762037 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.762200 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.762352 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.762501 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.762651 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.762802 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.762952 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.763126 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.763288 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.763439 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.763600 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.763752 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.763914 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.764073 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.764073 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.764374 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.764526 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.764684 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.764844 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.765014 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.765193 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.765355 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.765507 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.765656 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.765818 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.765989 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.767221 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.767328 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.767429 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.767515 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.767602 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.767676 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.767747 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.767827 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.767898 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.767984 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.768057 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.768138 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.768209 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.768287 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.768365 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.768449 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.768522 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.768600 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.768672 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.768743 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.768819 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.768910 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.768991 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.769236 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.769339 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.769414 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.769491 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.769577 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.769650 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.769727 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.769824 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.769910 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.769996 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.770070 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.770141 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.770211 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.770287 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.770369 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.770464 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.770557 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.770648 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.770760 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.770833 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.770924 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.771017 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.771102 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.771193 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.771284 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.771368 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.771452 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.771548 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.771632 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.771723 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.771807 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.771890 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.771985 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.772077 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.772161 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.772251 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.772335 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.772425 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.772526 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.772650 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.772749 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.772829 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.772921 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.773006 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.773116 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.773205 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.773289 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.773380 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.773463 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.773555 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.773648 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.773732 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.773815 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.773899 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.773981 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.774073 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.774158 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.774241 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.774324 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.774431 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.774516 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.774617 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.774710 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.774802 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.774893 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.774977 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.775068 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.775221 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.775319 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.775405 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.775489 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.775572 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.775664 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.775839 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.775955 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.776161 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.776286 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.776466 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.776561 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.776779 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.776880 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.777117 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.777308 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.777474 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.777742 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.777921 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.778081 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.778240 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.778403 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.778563 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.778714 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.778864 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.779012 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.779171 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.779322 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.779473 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.779621 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.779782 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.779953 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.780113 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.780264 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.780413 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.780564 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.780713 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.780955 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.781147 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.781314 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.781474 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.781626 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.781783 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.781944 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.782680 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.782873 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.783030 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.783189 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.783353 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.783517 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.783670 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.783832 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.783982 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.784132 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.784290 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.784459 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.784621 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.784621 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.784922 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.785111 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.785280 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.785441 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.785592 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.785742 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.785892 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.786042 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.786192 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.786351 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.786351 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.786815 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.786970 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.787128 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.787292 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.787452 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.787603 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.787770 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.788022 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.788185 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.788355 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.788514 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.788667 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.788827 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.788978 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.789159 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.789336 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.789495 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.789654 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.789805 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.789957 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.790116 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.790278 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.790435 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.790593 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.790743 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.790910 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.791102 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.791254 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.791403 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.791564 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.791715 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.791873 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.792024 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.792181 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.792181 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.792488 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.792639 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.792809 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.792960 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.793147 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.793305 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.793455 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.793614 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.793781 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.793935 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.794086 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.794236 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.794393 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.794542 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.794707 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.794887 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.795046 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.795205 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.795365 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.795515 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.795672 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.795829 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.795979 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.796128 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.796355 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.796509 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.796660 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.796827 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.796979 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.797163 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.797327 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.797478 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.797661 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.797827 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.797827 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.798242 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.798408 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.798560 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.798717 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.798869 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.799052 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.799213 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.799372 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.799522 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.799672 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.799829 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.799986 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.800146 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.800305 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.800457 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.800606 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.800763 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.800937 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.801203 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.801380 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.801604 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.801788 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.801951 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.802117 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.802276 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.802434 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.802593 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.802750 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.802901 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.803064 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.803227 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.803376 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.803526 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.803684 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.803853 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.804019 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.804019 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.804313 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.804474 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.804627 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.804790 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.804941 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.805115 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.805284 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.805444 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.805597 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.805756 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.805908 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.806065 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.806216 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.806373 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.806523 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.806682 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.806841 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.806992 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.807142 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.807306 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.807468 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.807632 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.807792 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.807943 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.808101 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.808271 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.808434 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.808599 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.808752 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.808902 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.809059 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.809245 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.809421 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.809572 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.809735 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.809895 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.810054 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.810205 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.810368 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.810520 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.810670 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.810826 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.810986 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.811142 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.811312 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.811462 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.811619 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.811777 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.811940 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.812105 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.812280 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.812439 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.812592 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.812741 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.812891 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.813050 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.813275 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.813454 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.813608 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.813793 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.813950 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.814116 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.814332 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.814516 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.814684 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.814866 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.815018 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.815211 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.815409 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.815581 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.815790 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.815945 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.816097 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.816263 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.816422 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.816575 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.816727 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.816886 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.817046 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.817234 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.817397 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.817556 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.817715 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.817877 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.818110 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.818265 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.818415 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.818572 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.818731 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.818888 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.819054 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.819204 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.819204 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.819491 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.819641 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.819807 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.819972 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.820123 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.820281 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.820440 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.820604 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.820765 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.820916 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.821100 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.821271 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.821425 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.821583 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.821749 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.821749 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.822054 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.822204 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.822361 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.822520 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.822680 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.822832 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.822982 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.823132 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.823280 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.823448 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.823609 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.823779 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.823942 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.824094 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.824243 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.824407 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.824566 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.824717 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.824868 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.825026 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.825217 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.825379 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.825530 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.825681 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.825841 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.825990 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.826147 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.826381 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.826534 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.826693 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.826845 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.827027 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.827196 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.827347 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.827497 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.827655 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.827807 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.827976 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.828135 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.828287 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.828436 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.828586 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.828747 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.829487 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.829657 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.829812 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.829970 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.830123 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.830282 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.830454 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.830606 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.830758 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.830909 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.830909 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.831197 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.831356 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.831515 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.831666 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.831817 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.831817 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.832105 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.832268 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.832433 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.832585 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.832748 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.832900 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.833086 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.833248 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.833399 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.833550 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.833700 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.833700 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.834012 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.834165 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.834327 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.834479 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.834629 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.834787 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.834947 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.835100 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.835250 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.835493 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.835673 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.835673 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.835982 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.836136 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.836294 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.836465 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.836623 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.836623 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.836920 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.837158 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.837318 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.837602 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.837767 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.837934 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.838093 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.838253 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.838541 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.839027 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.839192 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.839359 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.839512 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.839671 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.839824 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.839982 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.840143 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.840297 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.840460 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.840611 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.840761 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.840920 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.841143 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.841311 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.841464 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.841624 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.841782 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.841934 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.842093 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.842258 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.842410 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.842560 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.842718 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.842870 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.843028 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.843189 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.843340 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.843491 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.843641 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.843813 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.843966 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.844117 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.844266 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.844417 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.844639 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.845342 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.845497 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.845660 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.845812 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.845962 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.846113 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.846277 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.846491 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.846658 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.846811 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.846969 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.847132 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.847335 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.847496 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.847656 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.847823 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.847974 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.848138 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.848289 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.848440 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.848591 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.848742 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.848892 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.848892 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.849222 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.849383 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.849541 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.849702 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.849873 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.850038 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.850191 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.850342 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.850492 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.850657 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.850819 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.850978 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.851129 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.851279 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.851428 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 05 14:58:46.851587 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.851587 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.851587 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.851587 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.851587 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.851587 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.851587 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.851587 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.852784 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.852784 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.852784 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.852784 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.852784 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.852784 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.852784 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.852784 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.853995 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.853995 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.853995 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.853995 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.854578 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.854578 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.854864 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.855051 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.855368 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.855992 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.856311 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.856682 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.856936 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.857279 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.857598 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.857915 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.858228 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.858545 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.858862 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.859177 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.859488 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.859802 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.860666 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.860666 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.860992 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.861230 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.861420 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.861734 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.862052 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.862570 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.862882 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.863214 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.863538 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.863862 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.864179 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.864493 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.864817 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.865150 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.865461 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.865772 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.866083 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.866387 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.866720 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.867018 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.867321 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.867641 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.867950 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.868495 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.868844 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.869183 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.869516 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.869840 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.870156 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.876492 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.876612 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_db.sqlalchemy.engines [None req-5cf5895c-8509-491b-9da5-7f8db0a3e94d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:58:46.876719 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.876719 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.876719 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.876719 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.876719 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.876719 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.876719 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.876719 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.877326 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.877326 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.877326 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.877326 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.877326 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.877326 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.877326 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.877326 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.877845 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.877845 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.877845 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.877845 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.877845 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.877845 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.877845 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.877845 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.878374 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.878374 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.878644 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.878951 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.879233 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.879562 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.879867 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.880174 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.880492 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.880803 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.881145 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.881463 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.881775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.882131 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.882493 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.883020 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.883412 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.883743 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.884093 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.884436 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.884747 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.885057 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.885394 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.885719 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.886033 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.886346 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.886654 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.886965 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.887278 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.887590 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.887913 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.888276 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.888591 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.888908 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.889269 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.889595 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.889918 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.890236 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.890556 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.890868 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.891178 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.892024 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.892320 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.892638 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.892970 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.893318 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.893643 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.894070 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.894384 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.894705 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.895027 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.895340 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.895667 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.895989 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.896302 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.896623 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.896933 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.897287 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.897629 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.897960 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.898285 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.898592 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.898897 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.899201 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.899510 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.899839 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.900171 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.900486 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.900809 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.901140 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.901466 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.901779 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.902104 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.902427 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.902751 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.903063 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.903398 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.903708 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.904022 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.904337 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.904649 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.904960 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.905293 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.905628 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.905957 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.906260 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.906584 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.907001 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.907769 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.908089 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.908401 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.908729 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.909042 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.909380 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.910854 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.910854 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.910854 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.910854 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.911223 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.911308 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.911584 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.911911 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.912262 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.912583 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.912932 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.913284 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.913602 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.913917 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.914224 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:58:46.914470 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 05 14:58:46.936657 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_db.sqlalchemy.engines [None req-0ae15f64-25ca-4e6f-adb0-075d9537bb35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128789) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:58:46.940867 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.context [None req-5cf5895c-8509-491b-9da5-7f8db0a3e94d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9ee8715e-15f7-4a00-a6ea-b782f272eaf8(cell1) {{(pid=128788) load_cells /opt/stack/nova/nova/context.py:464}} Jan 05 14:58:46.945221 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cf5895c-8509-491b-9da5-7f8db0a3e94d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:58:46.946820 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cf5895c-8509-491b-9da5-7f8db0a3e94d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:58:46.947636 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cf5895c-8509-491b-9da5-7f8db0a3e94d None None] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:58:46.949654 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cf5895c-8509-491b-9da5-7f8db0a3e94d None None] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:58:46.960947 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_db.sqlalchemy.engines [None req-5cf5895c-8509-491b-9da5-7f8db0a3e94d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:58:46.962322 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_db.sqlalchemy.engines [None req-5cf5895c-8509-491b-9da5-7f8db0a3e94d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:58:47.004860 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.context [None req-0ae15f64-25ca-4e6f-adb0-075d9537bb35 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9ee8715e-15f7-4a00-a6ea-b782f272eaf8(cell1) {{(pid=128789) load_cells /opt/stack/nova/nova/context.py:464}} Jan 05 14:58:47.009163 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0ae15f64-25ca-4e6f-adb0-075d9537bb35 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:58:47.010762 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0ae15f64-25ca-4e6f-adb0-075d9537bb35 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:58:47.011579 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0ae15f64-25ca-4e6f-adb0-075d9537bb35 None None] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:58:47.013544 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0ae15f64-25ca-4e6f-adb0-075d9537bb35 None None] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:58:47.025246 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_db.sqlalchemy.engines [None req-0ae15f64-25ca-4e6f-adb0-075d9537bb35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128789) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:58:47.026703 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_db.sqlalchemy.engines [None req-0ae15f64-25ca-4e6f-adb0-075d9537bb35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128789) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:58:47.124342 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_db.sqlalchemy.engines [None req-5cf5895c-8509-491b-9da5-7f8db0a3e94d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:58:47.192032 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_db.sqlalchemy.engines [None req-0ae15f64-25ca-4e6f-adb0-075d9537bb35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128789) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:58:47.447543 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: WARNING keystonemiddleware.auth_token [None req-5cf5895c-8509-491b-9da5-7f8db0a3e94d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 05 14:58:47.454015 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: WARNING keystonemiddleware.auth_token [None req-5cf5895c-8509-491b-9da5-7f8db0a3e94d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 05 14:58:47.516030 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: WARNING keystonemiddleware.auth_token [None req-0ae15f64-25ca-4e6f-adb0-075d9537bb35 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 05 14:58:47.523113 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: WARNING keystonemiddleware.auth_token [None req-0ae15f64-25ca-4e6f-adb0-075d9537bb35 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 05 14:58:47.794421 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: WARNING keystonemiddleware.auth_token [None req-5cf5895c-8509-491b-9da5-7f8db0a3e94d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 05 14:58:47.799672 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: WARNING keystonemiddleware.auth_token [None req-5cf5895c-8509-491b-9da5-7f8db0a3e94d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 05 14:58:47.804983 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563f0432f9c0 pid: 128788 (default app) Jan 05 14:58:47.867377 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: WARNING keystonemiddleware.auth_token [None req-0ae15f64-25ca-4e6f-adb0-075d9537bb35 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 05 14:58:47.872546 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: WARNING keystonemiddleware.auth_token [None req-0ae15f64-25ca-4e6f-adb0-075d9537bb35 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 05 14:58:47.878364 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563f0432f9c0 pid: 128789 (default app) Jan 05 14:59:23.090217 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7523ebe9-6e13-4724-a96c-cd3f89a058f7 tempest-VolumesGetTestJSON-398344762 tempest-VolumesGetTestJSON-398344762-project] Action: 'create', calling method: .version_select at 0x7f2174398160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1760543792", "metadata": {"Type": "work"}}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:59:23.294031 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c6db1466-be0b-4878-846d-a9d3061d11a8 tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] Action: 'create', calling method: .version_select at 0x7f2174399160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-276353615", "metadata": {"Type": "work"}}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:59:23.295812 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c6db1466-be0b-4878-846d-a9d3061d11a8 tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 14:59:23.296778 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c6db1466-be0b-4878-846d-a9d3061d11a8 tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.821455 Jan 05 14:59:23.301463 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Jan 5 14:59:22 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 827 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 05 14:59:23.370826 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-cdd849e6-a6e8-41e6-9914-1c2f99ded758 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Action: 'create', calling method: .version_select at 0x7f2174399d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-245257423"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:59:24.336272 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7523ebe9-6e13-4724-a96c-cd3f89a058f7 tempest-VolumesGetTestJSON-398344762 tempest-VolumesGetTestJSON-398344762-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.701217 Jan 05 14:59:24.336976 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1/2] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Jan 5 14:59:21 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2703 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 05 14:59:24.342014 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de36e128-e37b-4036-b100-72143fdeb06d tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] Action: 'create', calling method: .version_select at 0x7f2174398d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1959421887", "metadata": {"Type": "work"}}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:59:24.344273 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de36e128-e37b-4036-b100-72143fdeb06d tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 14:59:24.345174 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-de36e128-e37b-4036-b100-72143fdeb06d tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006935 Jan 05 14:59:24.345767 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2/3] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Jan 5 14:59:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 05 14:59:24.367597 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-05550762-e1e4-42fc-b22f-36ac91d28b99 tempest-VolumesGetTestJSON-398344762 tempest-VolumesGetTestJSON-398344762-project] Calling method '.version_select at 0x7f2174bc79d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:24.420586 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-05550762-e1e4-42fc-b22f-36ac91d28b99 tempest-VolumesGetTestJSON-398344762 tempest-VolumesGetTestJSON-398344762-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/ddcefe43-3fe1-4372-9bf3-f6d1d125d9f6" status: 200 len: 353 microversion: 2.1 time: 0.073282 Jan 05 14:59:24.421178 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3/4] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Jan 5 14:59:24 2022] GET /compute/v2.1/os-volumes/ddcefe43-3fe1-4372-9bf3-f6d1d125d9f6 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:24.426241 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7faf2ab8-8450-4eeb-aa83-c91357e2b184 tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] Action: 'create', calling method: .version_select at 0x7f21741f1040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1343654955", "metadata": {"Type": "work"}}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:59:24.427440 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7faf2ab8-8450-4eeb-aa83-c91357e2b184 tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 14:59:24.428459 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7faf2ab8-8450-4eeb-aa83-c91357e2b184 tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006143 Jan 05 14:59:24.428963 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4/5] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Jan 5 14:59:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 05 14:59:24.478510 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-988f60d6-228a-4f45-a36e-b1a92f8169cb tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] Calling method '.version_select at 0x7f21741f51f0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:24.512739 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-988f60d6-228a-4f45-a36e-b1a92f8169cb tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] HTTP exception thrown: Volume tempest-invalid-1739592960 could not be found. Jan 05 14:59:24.512739 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-988f60d6-228a-4f45-a36e-b1a92f8169cb tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] Returning 404 to user: Volume tempest-invalid-1739592960 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 14:59:24.512739 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-988f60d6-228a-4f45-a36e-b1a92f8169cb tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1739592960" status: 404 len: 99 microversion: 2.1 time: 0.032982 Jan 05 14:59:24.513315 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 5/6] 10.222.0.30 () {58 vars in 1217 bytes} [Wed Jan 5 14:59:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1739592960 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 05 14:59:24.519074 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8821e8ca-67a8-4ffd-b80c-32f9990cab5c tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004462 Jan 05 14:59:24.523537 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 6/7] 10.222.0.30 () {58 vars in 1139 bytes} [Wed Jan 5 14:59:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 05 14:59:24.528501 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5645af1f-520e-438b-85f0-34592b5df943 tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003673 Jan 05 14:59:24.529206 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 7/8] 10.222.0.30 () {58 vars in 1136 bytes} [Wed Jan 5 14:59:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 05 14:59:24.539591 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5baf87e1-162f-4562-9a3b-8d6a463517d7 tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] Calling method '.version_select at 0x7f21741f1a60>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:24.579976 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-5baf87e1-162f-4562-9a3b-8d6a463517d7 tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] HTTP exception thrown: Volume 441da59f-3d1b-45c5-a2cc-6a61746234e2 could not be found. Jan 05 14:59:24.580854 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5baf87e1-162f-4562-9a3b-8d6a463517d7 tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] Returning 404 to user: Volume 441da59f-3d1b-45c5-a2cc-6a61746234e2 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 14:59:24.581875 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5baf87e1-162f-4562-9a3b-8d6a463517d7 tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/441da59f-3d1b-45c5-a2cc-6a61746234e2" status: 404 len: 109 microversion: 2.1 time: 0.046996 Jan 05 14:59:24.582521 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 8/9] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Jan 5 14:59:24 2022] DELETE /compute/v2.1/os-volumes/441da59f-3d1b-45c5-a2cc-6a61746234e2 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 05 14:59:24.594325 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c35bcc5d-a544-4b7e-a41c-99948c3f5af4 tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] Calling method '.version_select at 0x7f21741f1c10>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:24.628839 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-c35bcc5d-a544-4b7e-a41c-99948c3f5af4 tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] HTTP exception thrown: Volume dd4a71c7-16fb-4f5e-a78f-f83a128ea366 could not be found. Jan 05 14:59:24.630002 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c35bcc5d-a544-4b7e-a41c-99948c3f5af4 tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] Returning 404 to user: Volume dd4a71c7-16fb-4f5e-a78f-f83a128ea366 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 14:59:24.631681 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c35bcc5d-a544-4b7e-a41c-99948c3f5af4 tempest-VolumesNegativeTest-415548433 tempest-VolumesNegativeTest-415548433-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/dd4a71c7-16fb-4f5e-a78f-f83a128ea366" status: 404 len: 109 microversion: 2.1 time: 0.041735 Jan 05 14:59:24.632684 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 9/10] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Jan 5 14:59:24 2022] GET /compute/v2.1/os-volumes/dd4a71c7-16fb-4f5e-a78f-f83a128ea366 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 14:59:24.773709 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-cdd849e6-a6e8-41e6-9914-1c2f99ded758 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.470778 Jan 05 14:59:24.774945 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 2/11] 10.222.0.30 () {60 vars in 1154 bytes} [Wed Jan 5 14:59:23 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1473 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 05 14:59:24.826917 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-42b30128-6b8c-4b73-99d7-99e2a9750097 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Calling method '.version_select at 0x7f2174bc7a60>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:24.902949 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-42b30128-6b8c-4b73-99d7-99e2a9750097 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/9111068a-fb76-4623-9efb-7fa0026b6522" status: 200 len: 344 microversion: 2.1 time: 0.079691 Jan 05 14:59:24.903516 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 10/12] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Jan 5 14:59:24 2022] GET /compute/v2.1/os-volumes/9111068a-fb76-4623-9efb-7fa0026b6522 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:25.361620 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ba9bc2bc-d1aa-4527-891c-6be4b87dcf11 tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] Calling method '.version_select at 0x7f217425df70>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:25.444617 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ba9bc2bc-d1aa-4527-891c-6be4b87dcf11 tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a3407e44-8c80-4a94-a71a-63843f41d249" status: 200 len: 351 microversion: 2.1 time: 0.086565 Jan 05 14:59:25.445483 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 11/13] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Jan 5 14:59:25 2022] GET /compute/v2.1/os-volumes/a3407e44-8c80-4a94-a71a-63843f41d249 => generated 351 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 14:59:25.451112 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b0a77526-ef86-4014-89ea-2ca014dfe54c tempest-VolumesGetTestJSON-398344762 tempest-VolumesGetTestJSON-398344762-project] Calling method '.version_select at 0x7f21741f18b0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:25.544219 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1067845834", "imageRef": "e4c11159-1e41-437a-af97-eb5f10704ae6", "flavorRef": "452", "networks": [{"uuid": "fca65618-396e-44a0-8e47-55fa90240fd2"}]}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:59:25.567327 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b0a77526-ef86-4014-89ea-2ca014dfe54c tempest-VolumesGetTestJSON-398344762 tempest-VolumesGetTestJSON-398344762-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/ddcefe43-3fe1-4372-9bf3-f6d1d125d9f6" status: 200 len: 354 microversion: 2.1 time: 0.120199 Jan 05 14:59:25.568072 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 12/14] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Jan 5 14:59:25 2022] GET /compute/v2.1/os-volumes/ddcefe43-3fe1-4372-9bf3-f6d1d125d9f6 => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:25.636490 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bee4dfca-6cb7-4a6a-82c9-5b6e90fb0dea tempest-VolumesGetTestJSON-398344762 tempest-VolumesGetTestJSON-398344762-project] Calling method '.version_select at 0x7f21741f50d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:25.705678 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bee4dfca-6cb7-4a6a-82c9-5b6e90fb0dea tempest-VolumesGetTestJSON-398344762 tempest-VolumesGetTestJSON-398344762-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/ddcefe43-3fe1-4372-9bf3-f6d1d125d9f6" status: 200 len: 354 microversion: 2.1 time: 0.074144 Jan 05 14:59:25.706248 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 13/15] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Jan 5 14:59:25 2022] GET /compute/v2.1/os-volumes/ddcefe43-3fe1-4372-9bf3-f6d1d125d9f6 => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 14:59:25.722320 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-941dbbb2-da04-4a25-a4a3-0d1d1840be3d tempest-VolumesGetTestJSON-398344762 tempest-VolumesGetTestJSON-398344762-project] Calling method '.version_select at 0x7f21741f1040>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:25.746749 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.network.neutron [None req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] validate_networks() for [('fca65618-396e-44a0-8e47-55fa90240fd2', None, None, None, None, None)] {{(pid=128789) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 14:59:25.986907 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-941dbbb2-da04-4a25-a4a3-0d1d1840be3d tempest-VolumesGetTestJSON-398344762 tempest-VolumesGetTestJSON-398344762-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/ddcefe43-3fe1-4372-9bf3-f6d1d125d9f6" status: 202 len: 0 microversion: 2.1 time: 0.267797 Jan 05 14:59:25.988086 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 14/16] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Jan 5 14:59:25 2022] DELETE /compute/v2.1/os-volumes/ddcefe43-3fe1-4372-9bf3-f6d1d125d9f6 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 05 14:59:25.996993 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1ea2429e-d8ff-4a68-8f71-449b7d1a172b tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Calling method '.version_select at 0x7f21741f1940>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:26.072731 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1ea2429e-d8ff-4a68-8f71-449b7d1a172b tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/9111068a-fb76-4623-9efb-7fa0026b6522" status: 200 len: 345 microversion: 2.1 time: 0.079961 Jan 05 14:59:26.073575 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 15/17] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Jan 5 14:59:25 2022] GET /compute/v2.1/os-volumes/9111068a-fb76-4623-9efb-7fa0026b6522 => generated 345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:26.081310 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a2ee2dcc-6092-487b-9ced-3a349254c7a5 tempest-VolumesGetTestJSON-398344762 tempest-VolumesGetTestJSON-398344762-project] Calling method '.version_select at 0x7f217425de50>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:26.186876 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a2ee2dcc-6092-487b-9ced-3a349254c7a5 tempest-VolumesGetTestJSON-398344762 tempest-VolumesGetTestJSON-398344762-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/ddcefe43-3fe1-4372-9bf3-f6d1d125d9f6" status: 200 len: 353 microversion: 2.1 time: 0.112060 Jan 05 14:59:26.188280 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 16/18] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Jan 5 14:59:26 2022] GET /compute/v2.1/os-volumes/ddcefe43-3fe1-4372-9bf3-f6d1d125d9f6 => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:26.199139 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4c48e45f-619c-41ee-9599-cc55dabaef4a tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Action: 'create', calling method: .version_select at 0x7f21741f51f0>, body: {"snapshot": {"volume_id": "9111068a-fb76-4623-9efb-7fa0026b6522", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1585281152"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:59:26.998607 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4c48e45f-619c-41ee-9599-cc55dabaef4a tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.804196 Jan 05 14:59:26.999801 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 17/19] 10.222.0.30 () {60 vars in 1161 bytes} [Wed Jan 5 14:59:26 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:27.014757 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9cb53ef9-297d-489c-9598-1fb4767db1c6 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Calling method '.version_select at 0x7f21741f53a0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:27.147420 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Flavor limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 14:59:27.147420 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Image limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 14:59:27.147420 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Flavor pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 14:59:27.147420 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Image pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 14:59:27.147420 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 14:59:27.186133 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9cb53ef9-297d-489c-9598-1fb4767db1c6 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/b89cc97e-bd5c-4613-b834-179e7abb6c6b" status: 200 len: 287 microversion: 2.1 time: 0.175496 Jan 05 14:59:27.187379 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 18/20] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Jan 5 14:59:27 2022] GET /compute/v2.1/os-snapshots/b89cc97e-bd5c-4613-b834-179e7abb6c6b => generated 287 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 14:59:27.189181 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:27.190046 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:27.192457 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:27.192911 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:27.198327 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d255a0bc-58d9-44e9-9d16-d8611219fa98 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Calling method '.version_select at 0x7f21741f5670>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:27.304444 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d255a0bc-58d9-44e9-9d16-d8611219fa98 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.101306 Jan 05 14:59:27.306281 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 19/21] 10.222.0.30 () {58 vars in 1139 bytes} [Wed Jan 5 14:59:27 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:27.316828 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d1ee7c68-15fb-419b-bcbc-af13b6e20c79 tempest-VolumesGetTestJSON-398344762 tempest-VolumesGetTestJSON-398344762-project] Calling method '.version_select at 0x7f21741f19d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:27.318974 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Getting quotas for project fc623d81b10e491ab3a65d62b99bf7c7. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 14:59:27.337187 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Getting quotas for user c439b7ebe2d44b4ca60a269bd60520e8 and project fc623d81b10e491ab3a65d62b99bf7c7. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 14:59:27.372469 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Going to run 1 instances... {{(pid=128789) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 14:59:27.382638 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4c11159-1e41-437a-af97-eb5f10704ae6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 14:59:27.394022 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-d1ee7c68-15fb-419b-bcbc-af13b6e20c79 tempest-VolumesGetTestJSON-398344762 tempest-VolumesGetTestJSON-398344762-project] HTTP exception thrown: Volume ddcefe43-3fe1-4372-9bf3-f6d1d125d9f6 could not be found. Jan 05 14:59:27.394667 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d1ee7c68-15fb-419b-bcbc-af13b6e20c79 tempest-VolumesGetTestJSON-398344762 tempest-VolumesGetTestJSON-398344762-project] Returning 404 to user: Volume ddcefe43-3fe1-4372-9bf3-f6d1d125d9f6 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 14:59:27.396340 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d1ee7c68-15fb-419b-bcbc-af13b6e20c79 tempest-VolumesGetTestJSON-398344762 tempest-VolumesGetTestJSON-398344762-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/ddcefe43-3fe1-4372-9bf3-f6d1d125d9f6" status: 404 len: 109 microversion: 2.1 time: 0.088275 Jan 05 14:59:27.400181 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 20/22] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Jan 5 14:59:27 2022] GET /compute/v2.1/os-volumes/ddcefe43-3fe1-4372-9bf3-f6d1d125d9f6 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 14:59:27.407649 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1ebecba3-2574-4f38-8c4c-5206a824ce2b tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Calling method '.version_select at 0x7f21741f18b0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:27.448648 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1ebecba3-2574-4f38-8c4c-5206a824ce2b tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/b89cc97e-bd5c-4613-b834-179e7abb6c6b" status: 200 len: 287 microversion: 2.1 time: 0.047114 Jan 05 14:59:27.449314 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 21/23] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Jan 5 14:59:27 2022] GET /compute/v2.1/os-snapshots/b89cc97e-bd5c-4613-b834-179e7abb6c6b => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:27.457546 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cdd79a72-3713-493a-b850-66b830b1f688 tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] Calling method '.version_select at 0x7f217425df70>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:27.665859 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cdd79a72-3713-493a-b850-66b830b1f688 tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1c12210a-12b6-4b61-9c1c-4c5932e72a3e" status: 200 len: 350 microversion: 2.1 time: 0.076909 Jan 05 14:59:27.665859 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 22/24] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Jan 5 14:59:27 2022] GET /compute/v2.1/os-volumes/1c12210a-12b6-4b61-9c1c-4c5932e72a3e => generated 350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:27.676840 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.347235 Jan 05 14:59:27.708887 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 3/25] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 14:59:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 05 14:59:27.722853 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9324daa5-fc13-4894-9863-41159db8090f tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:27.722853 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9324daa5-fc13-4894-9863-41159db8090f tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:27.872899 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-9324daa5-fc13-4894-9863-41159db8090f tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:27.902002 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9324daa5-fc13-4894-9863-41159db8090f tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1215 microversion: 2.1 time: 0.213776 Jan 05 14:59:27.902644 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 23/26] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:27 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1215 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:28.462937 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f06397ae-c6be-4f38-b8f9-1c9d6c4bd1a0 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Calling method '.version_select at 0x7f21738f54c0>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:28.557577 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f06397ae-c6be-4f38-b8f9-1c9d6c4bd1a0 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/b89cc97e-bd5c-4613-b834-179e7abb6c6b" status: 200 len: 287 microversion: 2.1 time: 0.099850 Jan 05 14:59:28.559009 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 4/27] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Jan 5 14:59:28 2022] GET /compute/v2.1/os-snapshots/b89cc97e-bd5c-4613-b834-179e7abb6c6b => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:28.919958 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ccb214a2-ec88-4dd3-9b72-5d22bbc716d1 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:28.921840 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ccb214a2-ec88-4dd3-9b72-5d22bbc716d1 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:29.012589 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-ccb214a2-ec88-4dd3-9b72-5d22bbc716d1 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:29.021854 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ccb214a2-ec88-4dd3-9b72-5d22bbc716d1 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1215 microversion: 2.1 time: 0.106460 Jan 05 14:59:29.025483 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 24/28] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:28 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1215 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:29.570974 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-35996858-30ae-4b8e-ad85-ae2a17319cf7 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Calling method '.version_select at 0x7f21738f5f70>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:29.633505 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-35996858-30ae-4b8e-ad85-ae2a17319cf7 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/b89cc97e-bd5c-4613-b834-179e7abb6c6b" status: 200 len: 287 microversion: 2.1 time: 0.066771 Jan 05 14:59:29.634783 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 5/29] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Jan 5 14:59:29 2022] GET /compute/v2.1/os-snapshots/b89cc97e-bd5c-4613-b834-179e7abb6c6b => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:30.060370 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-164be83a-ff9f-4ae3-b13e-09ce527bf0ca tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:30.062789 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-164be83a-ff9f-4ae3-b13e-09ce527bf0ca tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:30.564693 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-164be83a-ff9f-4ae3-b13e-09ce527bf0ca tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:30.581139 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-164be83a-ff9f-4ae3-b13e-09ce527bf0ca tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1215 microversion: 2.1 time: 0.541625 Jan 05 14:59:30.625705 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 25/30] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:30 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1215 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:30.648080 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f01f3f3a-e1db-42f6-8eb8-532dd414aeec tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Calling method '.version_select at 0x7f21738f5820>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:31.138886 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-38fb3adc-0e3e-4424-ab4b-989dedb71e5d tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] Calling method '.version_select at 0x7f21741f5940>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:31.165531 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f01f3f3a-e1db-42f6-8eb8-532dd414aeec tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/b89cc97e-bd5c-4613-b834-179e7abb6c6b" status: 200 len: 288 microversion: 2.1 time: 0.362694 Jan 05 14:59:31.165531 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 6/31] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Jan 5 14:59:30 2022] GET /compute/v2.1/os-snapshots/b89cc97e-bd5c-4613-b834-179e7abb6c6b => generated 288 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:31.165531 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b8626f67-9252-412b-a15b-bb9b3d965ee0 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Calling method '.version_select at 0x7f2173912700>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:31.166964 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-38fb3adc-0e3e-4424-ab4b-989dedb71e5d tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/9a0e76c6-c909-4705-9e44-0b10af18541c" status: 200 len: 351 microversion: 2.1 time: 0.140948 Jan 05 14:59:31.166964 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 26/32] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Jan 5 14:59:30 2022] GET /compute/v2.1/os-volumes/9a0e76c6-c909-4705-9e44-0b10af18541c => generated 351 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:31.166964 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b60f9542-4e8d-4172-a2f3-c3fbb6be78ba tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] Calling method '.version_select at 0x7f21741cda60>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:31.382474 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b8626f67-9252-412b-a15b-bb9b3d965ee0 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/b89cc97e-bd5c-4613-b834-179e7abb6c6b" status: 202 len: 0 microversion: 2.1 time: 0.370983 Jan 05 14:59:31.383582 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 7/33] 10.222.0.30 () {58 vars in 1253 bytes} [Wed Jan 5 14:59:31 2022] DELETE /compute/v2.1/os-snapshots/b89cc97e-bd5c-4613-b834-179e7abb6c6b => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 05 14:59:31.387065 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b60f9542-4e8d-4172-a2f3-c3fbb6be78ba tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.260759 Jan 05 14:59:31.398297 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 27/34] 10.222.0.30 () {58 vars in 1133 bytes} [Wed Jan 5 14:59:31 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 14:59:31.401753 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c843ee7f-d0c7-443f-8e6e-5dd4d5ebb295 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Calling method '.version_select at 0x7f21738f5820>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:31.407666 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2693456-059b-4a0b-ac95-9edc5e5b5832 tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] Calling method '.version_select at 0x7f21741c9700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:31.463991 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c843ee7f-d0c7-443f-8e6e-5dd4d5ebb295 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/b89cc97e-bd5c-4613-b834-179e7abb6c6b" status: 200 len: 287 microversion: 2.1 time: 0.076055 Jan 05 14:59:31.464566 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 8/35] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Jan 5 14:59:31 2022] GET /compute/v2.1/os-snapshots/b89cc97e-bd5c-4613-b834-179e7abb6c6b => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:31.574936 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e2693456-059b-4a0b-ac95-9edc5e5b5832 tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.174825 Jan 05 14:59:31.584553 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 28/36] 10.222.0.30 () {58 vars in 1148 bytes} [Wed Jan 5 14:59:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:31.588503 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b6bf41c0-84dc-4a1c-94ec-3d5ca647ef7e tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] Calling method '.version_select at 0x7f21738f5f70>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:31.643079 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-41136a37-1617-4860-9f8e-91b3602eef62 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:31.643631 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-41136a37-1617-4860-9f8e-91b3602eef62 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:31.663588 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41136a37-1617-4860-9f8e-91b3602eef62 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:31.669977 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41136a37-1617-4860-9f8e-91b3602eef62 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:31.673457 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41136a37-1617-4860-9f8e-91b3602eef62 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:31.673457 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41136a37-1617-4860-9f8e-91b3602eef62 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:31.733319 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b6bf41c0-84dc-4a1c-94ec-3d5ca647ef7e tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.149259 Jan 05 14:59:31.740211 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 9/37] 10.222.0.30 () {58 vars in 1133 bytes} [Wed Jan 5 14:59:31 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 14:59:31.755925 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f095cabb-26e5-4e06-aca9-14157a1db05a tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] Calling method '.version_select at 0x7f2173912040>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:31.980417 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f095cabb-26e5-4e06-aca9-14157a1db05a tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.237639 Jan 05 14:59:31.990426 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 10/38] 10.222.0.30 () {58 vars in 1166 bytes} [Wed Jan 5 14:59:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:31.995426 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-17f9f632-96eb-42a9-ad01-0d119e799f4f tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] Calling method '.version_select at 0x7f2173912550>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:32.162833 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-17f9f632-96eb-42a9-ad01-0d119e799f4f tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.163129 Jan 05 14:59:32.162833 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 11/39] 10.222.0.30 () {58 vars in 1169 bytes} [Wed Jan 5 14:59:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:32.167546 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-00a2e726-faab-412c-b923-a2a22288278e tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] Calling method '.version_select at 0x7f21738f5670>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:32.290342 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-00a2e726-faab-412c-b923-a2a22288278e tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.126233 Jan 05 14:59:32.297897 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 12/40] 10.222.0.30 () {58 vars in 1154 bytes} [Wed Jan 5 14:59:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 14:59:32.302415 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-bed20b88-1749-47ed-a655-2547893de625 tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] Calling method '.version_select at 0x7f2173915430>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:32.310751 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-41136a37-1617-4860-9f8e-91b3602eef62 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:32.339785 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-41136a37-1617-4860-9f8e-91b3602eef62 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1211 microversion: 2.1 time: 0.701644 Jan 05 14:59:32.340760 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 29/41] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:31 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1211 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:32.446663 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-bed20b88-1749-47ed-a655-2547893de625 tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.148053 Jan 05 14:59:32.447239 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 13/42] 10.222.0.30 () {58 vars in 1187 bytes} [Wed Jan 5 14:59:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:32.469880 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-007b52a4-2944-4460-95c2-0b8833455e24 tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] Calling method '.version_select at 0x7f2174145ee0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:32.478982 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-43b44a4d-4dbf-4dc5-acbb-ca40778c3223 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Calling method '.version_select at 0x7f2173915b80>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:32.553243 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-43b44a4d-4dbf-4dc5-acbb-ca40778c3223 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] HTTP exception thrown: Snapshot b89cc97e-bd5c-4613-b834-179e7abb6c6b could not be found. Jan 05 14:59:32.553845 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-43b44a4d-4dbf-4dc5-acbb-ca40778c3223 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Returning 404 to user: Snapshot b89cc97e-bd5c-4613-b834-179e7abb6c6b could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 14:59:32.554686 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-43b44a4d-4dbf-4dc5-acbb-ca40778c3223 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/b89cc97e-bd5c-4613-b834-179e7abb6c6b" status: 404 len: 111 microversion: 2.1 time: 0.081068 Jan 05 14:59:32.555587 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 14/43] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Jan 5 14:59:32 2022] GET /compute/v2.1/os-snapshots/b89cc97e-bd5c-4613-b834-179e7abb6c6b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 14:59:32.566467 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d3120b8d-555c-4c5a-9612-17f304d8dce7 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Calling method '.version_select at 0x7f21739150d0>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:32.717514 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-007b52a4-2944-4460-95c2-0b8833455e24 tempest-VolumesTestJSON-218692735 tempest-VolumesTestJSON-218692735-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.260578 Jan 05 14:59:32.719587 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 30/44] 10.222.0.30 () {58 vars in 1154 bytes} [Wed Jan 5 14:59:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:32.887215 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d3120b8d-555c-4c5a-9612-17f304d8dce7 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/9111068a-fb76-4623-9efb-7fa0026b6522" status: 202 len: 0 microversion: 2.1 time: 0.324306 Jan 05 14:59:32.888651 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 15/45] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Jan 5 14:59:32 2022] DELETE /compute/v2.1/os-volumes/9111068a-fb76-4623-9efb-7fa0026b6522 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 14:59:32.898555 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d34c8a44-83bf-42ce-a15a-1614146f2d84 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Calling method '.version_select at 0x7f21741004c0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:32.985526 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d34c8a44-83bf-42ce-a15a-1614146f2d84 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/9111068a-fb76-4623-9efb-7fa0026b6522" status: 200 len: 344 microversion: 2.1 time: 0.090543 Jan 05 14:59:32.986762 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 31/46] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Jan 5 14:59:32 2022] GET /compute/v2.1/os-volumes/9111068a-fb76-4623-9efb-7fa0026b6522 => generated 344 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:33.360353 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-083eb5fb-4781-47d9-b414-860580cb438f tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:33.362648 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-083eb5fb-4781-47d9-b414-860580cb438f tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:33.407144 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-083eb5fb-4781-47d9-b414-860580cb438f tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:33.408093 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-083eb5fb-4781-47d9-b414-860580cb438f tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:33.409827 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-083eb5fb-4781-47d9-b414-860580cb438f tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:33.410422 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-083eb5fb-4781-47d9-b414-860580cb438f tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:33.858575 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-083eb5fb-4781-47d9-b414-860580cb438f tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:33.879020 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-083eb5fb-4781-47d9-b414-860580cb438f tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1275 microversion: 2.1 time: 0.524384 Jan 05 14:59:33.879890 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 16/47] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:33 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1275 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:34.000235 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-8852723a-681f-47b0-89dc-cb385760157b tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Calling method '.version_select at 0x7f21730225e0>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:34.051930 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-8852723a-681f-47b0-89dc-cb385760157b tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] HTTP exception thrown: Volume 9111068a-fb76-4623-9efb-7fa0026b6522 could not be found. Jan 05 14:59:34.052263 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-8852723a-681f-47b0-89dc-cb385760157b tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Returning 404 to user: Volume 9111068a-fb76-4623-9efb-7fa0026b6522 could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 14:59:34.053374 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-8852723a-681f-47b0-89dc-cb385760157b tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/9111068a-fb76-4623-9efb-7fa0026b6522" status: 404 len: 109 microversion: 2.1 time: 0.058280 Jan 05 14:59:34.054464 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 17/48] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Jan 5 14:59:33 2022] GET /compute/v2.1/os-volumes/9111068a-fb76-4623-9efb-7fa0026b6522 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 14:59:34.072733 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d75f5d49-9389-4efd-bef2-b74b97d7dda6 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Calling method '.version_select at 0x7f21730224c0>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:34.132023 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-d75f5d49-9389-4efd-bef2-b74b97d7dda6 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] HTTP exception thrown: Volume 9111068a-fb76-4623-9efb-7fa0026b6522 could not be found. Jan 05 14:59:34.132023 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d75f5d49-9389-4efd-bef2-b74b97d7dda6 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Returning 404 to user: Volume 9111068a-fb76-4623-9efb-7fa0026b6522 could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 14:59:34.132023 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d75f5d49-9389-4efd-bef2-b74b97d7dda6 tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/9111068a-fb76-4623-9efb-7fa0026b6522" status: 404 len: 109 microversion: 2.1 time: 0.067259 Jan 05 14:59:34.132992 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 18/49] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Jan 5 14:59:34 2022] DELETE /compute/v2.1/os-volumes/9111068a-fb76-4623-9efb-7fa0026b6522 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 14:59:34.147205 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d9b23af8-e542-462f-bc25-ef2d800bb26f tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Calling method '.version_select at 0x7f2173043ee0>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:34.202096 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-d9b23af8-e542-462f-bc25-ef2d800bb26f tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] HTTP exception thrown: Volume 9111068a-fb76-4623-9efb-7fa0026b6522 could not be found. Jan 05 14:59:34.203550 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d9b23af8-e542-462f-bc25-ef2d800bb26f tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] Returning 404 to user: Volume 9111068a-fb76-4623-9efb-7fa0026b6522 could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 14:59:34.204625 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d9b23af8-e542-462f-bc25-ef2d800bb26f tempest-VolumesSnapshotsTestJSON-1504416480 tempest-VolumesSnapshotsTestJSON-1504416480-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/9111068a-fb76-4623-9efb-7fa0026b6522" status: 404 len: 109 microversion: 2.1 time: 0.067858 Jan 05 14:59:34.205949 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 19/50] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Jan 5 14:59:34 2022] GET /compute/v2.1/os-volumes/9111068a-fb76-4623-9efb-7fa0026b6522 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 05 14:59:34.446331 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-51359e3d-13e8-4070-84fc-ce6f3148a524 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-533178016", "imageRef": "e4c11159-1e41-437a-af97-eb5f10704ae6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "975fa447-11a2-47cd-86bf-82619c2a8abd"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:59:34.710066 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-51359e3d-13e8-4070-84fc-ce6f3148a524 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] validate_networks() for [('975fa447-11a2-47cd-86bf-82619c2a8abd', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 14:59:34.901248 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-663cd0da-c169-43b5-9b28-bdcb0c133db2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:34.902150 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-663cd0da-c169-43b5-9b28-bdcb0c133db2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:34.923463 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-663cd0da-c169-43b5-9b28-bdcb0c133db2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:34.924337 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-663cd0da-c169-43b5-9b28-bdcb0c133db2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:34.926794 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-663cd0da-c169-43b5-9b28-bdcb0c133db2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:34.929930 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-663cd0da-c169-43b5-9b28-bdcb0c133db2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:35.092556 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-663cd0da-c169-43b5-9b28-bdcb0c133db2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:35.092556 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-663cd0da-c169-43b5-9b28-bdcb0c133db2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1273 microversion: 2.1 time: 0.167478 Jan 05 14:59:35.092556 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 20/51] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:34 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:36.474436 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ff6050b7-868a-488b-a3a1-588a392a2c14 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'create', calling method: .version_select at 0x7f2173043f70>, body: {"keypair": {"name": "tempest-keypair-32348512"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:59:36.528039 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-ff6050b7-868a-488b-a3a1-588a392a2c14 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Getting quotas for project 715006ffd8ba4e5b963511ec759ae152. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 14:59:36.534569 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-ff6050b7-868a-488b-a3a1-588a392a2c14 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Getting quotas for user 2de1d8ec06134669a4db8ca248feceae and project 715006ffd8ba4e5b963511ec759ae152. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 14:59:37.833656 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-ff6050b7-868a-488b-a3a1-588a392a2c14 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Getting quotas for project 715006ffd8ba4e5b963511ec759ae152. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 14:59:37.848340 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-ff6050b7-868a-488b-a3a1-588a392a2c14 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Getting quotas for user 2de1d8ec06134669a4db8ca248feceae and project 715006ffd8ba4e5b963511ec759ae152. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 14:59:37.910390 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ff6050b7-868a-488b-a3a1-588a392a2c14 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 2.292964 Jan 05 14:59:37.912372 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 21/52] 10.222.0.30 () {60 vars in 1157 bytes} [Wed Jan 5 14:59:35 2022] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:37.919755 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d1db01e7-b679-4a02-bb04-d5d4128b3e36 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:37.922578 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d1db01e7-b679-4a02-bb04-d5d4128b3e36 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:37.970775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d1db01e7-b679-4a02-bb04-d5d4128b3e36 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:37.970775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d1db01e7-b679-4a02-bb04-d5d4128b3e36 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:37.970775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d1db01e7-b679-4a02-bb04-d5d4128b3e36 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:37.970775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d1db01e7-b679-4a02-bb04-d5d4128b3e36 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:38.318745 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d1db01e7-b679-4a02-bb04-d5d4128b3e36 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:38.330473 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d1db01e7-b679-4a02-bb04-d5d4128b3e36 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.413357 Jan 05 14:59:38.333917 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 22/53] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:37 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:38.361455 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-51359e3d-13e8-4070-84fc-ce6f3148a524 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 14:59:38.363783 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-51359e3d-13e8-4070-84fc-ce6f3148a524 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 14:59:38.363783 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-51359e3d-13e8-4070-84fc-ce6f3148a524 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 14:59:38.363783 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-51359e3d-13e8-4070-84fc-ce6f3148a524 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 14:59:38.363783 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-51359e3d-13e8-4070-84fc-ce6f3148a524 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 14:59:38.381399 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51359e3d-13e8-4070-84fc-ce6f3148a524 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:38.382022 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51359e3d-13e8-4070-84fc-ce6f3148a524 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:38.382989 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51359e3d-13e8-4070-84fc-ce6f3148a524 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:38.387906 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51359e3d-13e8-4070-84fc-ce6f3148a524 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:38.429952 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-51359e3d-13e8-4070-84fc-ce6f3148a524 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Getting quotas for project 9c7d005c6e9e454fa506907144639917. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 14:59:38.448783 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-51359e3d-13e8-4070-84fc-ce6f3148a524 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Getting quotas for user 4295ba06618a45988ebeb45a82230bb0 and project 9c7d005c6e9e454fa506907144639917. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 14:59:38.487194 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-51359e3d-13e8-4070-84fc-ce6f3148a524 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 14:59:38.501357 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-51359e3d-13e8-4070-84fc-ce6f3148a524 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4c11159-1e41-437a-af97-eb5f10704ae6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 14:59:38.808500 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-51359e3d-13e8-4070-84fc-ce6f3148a524 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.010750 Jan 05 14:59:38.808500 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 32/54] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 14:59:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 5012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 05 14:59:38.818391 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b1e00218-f17c-4d87-94b3-051b68006abd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:38.819233 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b1e00218-f17c-4d87-94b3-051b68006abd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:39.052826 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b1e00218-f17c-4d87-94b3-051b68006abd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:39.089836 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b1e00218-f17c-4d87-94b3-051b68006abd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1221 microversion: 2.1 time: 0.276123 Jan 05 14:59:39.094484 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 23/55] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:38 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1221 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:39.350665 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f2ad8c15-d3cf-4fec-9f5c-c84a076bee18 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:39.351279 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f2ad8c15-d3cf-4fec-9f5c-c84a076bee18 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:39.361670 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2ad8c15-d3cf-4fec-9f5c-c84a076bee18 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:39.362278 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2ad8c15-d3cf-4fec-9f5c-c84a076bee18 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:39.362907 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2ad8c15-d3cf-4fec-9f5c-c84a076bee18 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:39.363345 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2ad8c15-d3cf-4fec-9f5c-c84a076bee18 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:39.762508 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-07324ee1-9d75-4737-b7a5-cba91160b05d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1482310582", "imageRef": "e4c11159-1e41-437a-af97-eb5f10704ae6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "975fa447-11a2-47cd-86bf-82619c2a8abd"}]}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:59:39.892674 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.network.neutron [None req-07324ee1-9d75-4737-b7a5-cba91160b05d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] validate_networks() for [('975fa447-11a2-47cd-86bf-82619c2a8abd', None, None, None, None, None)] {{(pid=128789) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 14:59:40.844631 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-07324ee1-9d75-4737-b7a5-cba91160b05d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Flavor limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 14:59:40.848374 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-07324ee1-9d75-4737-b7a5-cba91160b05d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Image limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 14:59:40.849377 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-07324ee1-9d75-4737-b7a5-cba91160b05d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Flavor pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 14:59:40.850298 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-07324ee1-9d75-4737-b7a5-cba91160b05d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Image pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 14:59:40.856852 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-07324ee1-9d75-4737-b7a5-cba91160b05d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 14:59:40.871553 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-07324ee1-9d75-4737-b7a5-cba91160b05d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:40.872430 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-07324ee1-9d75-4737-b7a5-cba91160b05d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:40.873929 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-07324ee1-9d75-4737-b7a5-cba91160b05d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:40.875095 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-07324ee1-9d75-4737-b7a5-cba91160b05d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:40.913591 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-07324ee1-9d75-4737-b7a5-cba91160b05d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Getting quotas for project 9c7d005c6e9e454fa506907144639917. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 14:59:40.922235 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-07324ee1-9d75-4737-b7a5-cba91160b05d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Getting quotas for user 4295ba06618a45988ebeb45a82230bb0 and project 9c7d005c6e9e454fa506907144639917. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 14:59:40.962356 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-07324ee1-9d75-4737-b7a5-cba91160b05d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Going to run 1 instances... {{(pid=128789) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 14:59:40.972205 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-07324ee1-9d75-4737-b7a5-cba91160b05d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4c11159-1e41-437a-af97-eb5f10704ae6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 14:59:41.114398 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-07324ee1-9d75-4737-b7a5-cba91160b05d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.354778 Jan 05 14:59:41.120970 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 24/56] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 14:59:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 05 14:59:41.127852 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d53f9a04-16db-4b0d-abdb-cac4f8bd7a9b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:41.128492 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d53f9a04-16db-4b0d-abdb-cac4f8bd7a9b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:41.527104 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d53f9a04-16db-4b0d-abdb-cac4f8bd7a9b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:41.539365 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d53f9a04-16db-4b0d-abdb-cac4f8bd7a9b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1222 microversion: 2.1 time: 0.416921 Jan 05 14:59:41.546294 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 25/57] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:41 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1222 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:41.925861 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-f2ad8c15-d3cf-4fec-9f5c-c84a076bee18 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:41.925861 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f2ad8c15-d3cf-4fec-9f5c-c84a076bee18 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 2.516046 Jan 05 14:59:41.925861 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 33/58] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:39 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 2522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:42.563230 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ad9fca1c-b07a-4099-8c7b-49b8e7ec213a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:42.564616 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ad9fca1c-b07a-4099-8c7b-49b8e7ec213a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:42.881706 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3b353fa7-7ede-4c53-84df-3f24bfbb45c8 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:42.882501 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3b353fa7-7ede-4c53-84df-3f24bfbb45c8 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:42.901916 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b353fa7-7ede-4c53-84df-3f24bfbb45c8 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:42.902400 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b353fa7-7ede-4c53-84df-3f24bfbb45c8 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:42.903217 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b353fa7-7ede-4c53-84df-3f24bfbb45c8 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:42.903662 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b353fa7-7ede-4c53-84df-3f24bfbb45c8 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:43.093324 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ad9fca1c-b07a-4099-8c7b-49b8e7ec213a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:43.093324 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ad9fca1c-b07a-4099-8c7b-49b8e7ec213a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1222 microversion: 2.1 time: 0.494558 Jan 05 14:59:43.093324 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 26/59] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:42 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1222 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:43.224548 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3b353fa7-7ede-4c53-84df-3f24bfbb45c8 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:43.241886 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3b353fa7-7ede-4c53-84df-3f24bfbb45c8 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.365223 Jan 05 14:59:43.252068 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 34/60] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:42 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:44.306290 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-4178b7c4-2481-42b2-8512-c6388a1db9a5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:44.306290 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-4178b7c4-2481-42b2-8512-c6388a1db9a5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:44.306290 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4178b7c4-2481-42b2-8512-c6388a1db9a5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:44.306290 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4178b7c4-2481-42b2-8512-c6388a1db9a5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:44.310763 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4178b7c4-2481-42b2-8512-c6388a1db9a5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:44.310763 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4178b7c4-2481-42b2-8512-c6388a1db9a5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:44.310763 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-4178b7c4-2481-42b2-8512-c6388a1db9a5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:44.311628 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-770d1748-6437-40f6-8e64-8761d251c5ab tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:44.311628 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-770d1748-6437-40f6-8e64-8761d251c5ab tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:44.311628 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-770d1748-6437-40f6-8e64-8761d251c5ab tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:44.314143 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-4178b7c4-2481-42b2-8512-c6388a1db9a5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1226 microversion: 2.1 time: 0.173527 Jan 05 14:59:44.314565 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-770d1748-6437-40f6-8e64-8761d251c5ab tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:44.314565 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-770d1748-6437-40f6-8e64-8761d251c5ab tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:44.315066 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 27/61] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:44 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1226 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:44.315362 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-770d1748-6437-40f6-8e64-8761d251c5ab tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:44.690946 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-770d1748-6437-40f6-8e64-8761d251c5ab tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:44.699399 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-770d1748-6437-40f6-8e64-8761d251c5ab tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.444108 Jan 05 14:59:44.700595 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 35/62] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:44 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:45.326208 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b22e8164-1f27-453f-b63f-19d4447f903b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:45.328682 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b22e8164-1f27-453f-b63f-19d4447f903b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:45.344958 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b22e8164-1f27-453f-b63f-19d4447f903b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:45.345984 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b22e8164-1f27-453f-b63f-19d4447f903b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:45.347010 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b22e8164-1f27-453f-b63f-19d4447f903b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:45.347652 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b22e8164-1f27-453f-b63f-19d4447f903b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:45.484382 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-254ddbe7-dbc3-4500-8f21-894487ef7551 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'create', calling method: .version_select at 0x7f2173015940>, body: {"keypair": {"name": "tempest-keypair-971799383"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:59:45.513540 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-254ddbe7-dbc3-4500-8f21-894487ef7551 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Getting quotas for project f4a45a70c5d046238abaad07fbe529e9. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 14:59:45.523035 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-254ddbe7-dbc3-4500-8f21-894487ef7551 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Getting quotas for user d43400b4646449ce94967ec5bab4eca1 and project f4a45a70c5d046238abaad07fbe529e9. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 14:59:45.554442 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b22e8164-1f27-453f-b63f-19d4447f903b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:45.568344 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b22e8164-1f27-453f-b63f-19d4447f903b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1218 microversion: 2.1 time: 0.250350 Jan 05 14:59:45.569057 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 36/63] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:45 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1218 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 14:59:45.667762 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1358a905-461b-43f3-97fa-f5885ffdf9af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1147998897", "imageRef": "e4c11159-1e41-437a-af97-eb5f10704ae6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb7bcda7-5039-4d82-bf68-12c9acc8a744"}], "security_groups": [{"name": "tempest-securitygroup--1690308885"}], "key_name": "tempest-keypair-32348512", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:59:46.128661 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-1358a905-461b-43f3-97fa-f5885ffdf9af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] validate_networks() for [('fb7bcda7-5039-4d82-bf68-12c9acc8a744', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 14:59:46.402068 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-254ddbe7-dbc3-4500-8f21-894487ef7551 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Getting quotas for project f4a45a70c5d046238abaad07fbe529e9. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 14:59:46.426823 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-254ddbe7-dbc3-4500-8f21-894487ef7551 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Getting quotas for user d43400b4646449ce94967ec5bab4eca1 and project f4a45a70c5d046238abaad07fbe529e9. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 14:59:46.620111 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-254ddbe7-dbc3-4500-8f21-894487ef7551 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 2.147883 Jan 05 14:59:46.620111 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 28/64] 10.222.0.30 () {62 vars in 1198 bytes} [Wed Jan 5 14:59:44 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 2154 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 05 14:59:46.620111 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e0e6bba9-968e-431f-a1e6-30c4197065d7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:46.620111 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e0e6bba9-968e-431f-a1e6-30c4197065d7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:46.620111 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e0e6bba9-968e-431f-a1e6-30c4197065d7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:46.621894 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e0e6bba9-968e-431f-a1e6-30c4197065d7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:46.621894 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e0e6bba9-968e-431f-a1e6-30c4197065d7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:46.621894 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e0e6bba9-968e-431f-a1e6-30c4197065d7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:47.018121 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e0e6bba9-968e-431f-a1e6-30c4197065d7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:47.024432 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e0e6bba9-968e-431f-a1e6-30c4197065d7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.571711 Jan 05 14:59:47.025488 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 29/65] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:46 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:47.244109 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1358a905-461b-43f3-97fa-f5885ffdf9af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 14:59:47.244624 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1358a905-461b-43f3-97fa-f5885ffdf9af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 14:59:47.246049 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1358a905-461b-43f3-97fa-f5885ffdf9af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 14:59:47.247182 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1358a905-461b-43f3-97fa-f5885ffdf9af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 14:59:47.248169 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1358a905-461b-43f3-97fa-f5885ffdf9af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 14:59:47.289896 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1358a905-461b-43f3-97fa-f5885ffdf9af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:47.291901 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1358a905-461b-43f3-97fa-f5885ffdf9af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:47.294434 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1358a905-461b-43f3-97fa-f5885ffdf9af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:47.295151 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1358a905-461b-43f3-97fa-f5885ffdf9af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:47.359154 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-1358a905-461b-43f3-97fa-f5885ffdf9af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Getting quotas for project 715006ffd8ba4e5b963511ec759ae152. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 14:59:47.368172 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-1358a905-461b-43f3-97fa-f5885ffdf9af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Getting quotas for user 2de1d8ec06134669a4db8ca248feceae and project 715006ffd8ba4e5b963511ec759ae152. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 14:59:47.408395 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1358a905-461b-43f3-97fa-f5885ffdf9af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 14:59:47.411247 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1358a905-461b-43f3-97fa-f5885ffdf9af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4c11159-1e41-437a-af97-eb5f10704ae6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 14:59:47.751422 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-82358378-d22c-4b96-bc0b-7d24ac42e2ab req-f868446b-9b2b-45b9-8ff0-8d4c0500a734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cf86612-a721-4032-9b56-b9828fc658cd", "tag": "a1de646c-827f-41ad-bab9-8457e33db96d"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:59:47.754597 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:47.754597 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 14:59:47.795348 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-82358378-d22c-4b96-bc0b-7d24ac42e2ab req-f868446b-9b2b-45b9-8ff0-8d4c0500a734 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:47.796395 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-82358378-d22c-4b96-bc0b-7d24ac42e2ab req-f868446b-9b2b-45b9-8ff0-8d4c0500a734 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:47.824721 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1358a905-461b-43f3-97fa-f5885ffdf9af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.161812 Jan 05 14:59:47.832783 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 37/66] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 14:59:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 2170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 14:59:47.842322 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-375a1315-4455-4b89-bbff-bb85dcae1965 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:47.849717 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-375a1315-4455-4b89-bbff-bb85dcae1965 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:47.850373 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-82358378-d22c-4b96-bc0b-7d24ac42e2ab req-f868446b-9b2b-45b9-8ff0-8d4c0500a734 service nova] Creating event network-changed:a1de646c-827f-41ad-bab9-8457e33db96d for instance 6cf86612-a721-4032-9b56-b9828fc658cd on hv-cinder-maste Jan 05 14:59:47.850921 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-82358378-d22c-4b96-bc0b-7d24ac42e2ab req-f868446b-9b2b-45b9-8ff0-8d4c0500a734 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128789) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 05 14:59:47.852081 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-058bdd5e-9409-4826-9579-feaffc3f5171 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:47.852521 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-058bdd5e-9409-4826-9579-feaffc3f5171 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:47.856537 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-058bdd5e-9409-4826-9579-feaffc3f5171 None None] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:47.856987 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-058bdd5e-9409-4826-9579-feaffc3f5171 None None] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:47.878897 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.compute.rpcapi [None req-058bdd5e-9409-4826-9579-feaffc3f5171 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 05 14:59:47.879830 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-058bdd5e-9409-4826-9579-feaffc3f5171 None None] Releasing lock "compute-rpcapi-router" {{(pid=128789) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 05 14:59:47.933824 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-058bdd5e-9409-4826-9579-feaffc3f5171 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.906181 Jan 05 14:59:47.934713 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 30/67] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 14:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:47.940528 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7c9dd50a-8697-44e1-b8b7-c5d841a88556 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:47.942961 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-375a1315-4455-4b89-bbff-bb85dcae1965 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:47.943093 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7c9dd50a-8697-44e1-b8b7-c5d841a88556 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:47.943372 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-375a1315-4455-4b89-bbff-bb85dcae1965 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:47.945908 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-375a1315-4455-4b89-bbff-bb85dcae1965 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:47.949387 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-375a1315-4455-4b89-bbff-bb85dcae1965 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:48.364469 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-375a1315-4455-4b89-bbff-bb85dcae1965 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:48.372748 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-375a1315-4455-4b89-bbff-bb85dcae1965 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1280 microversion: 2.1 time: 0.537861 Jan 05 14:59:48.377059 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 38/68] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:47 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1280 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:48.402706 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80a6dbd7-c3b5-41a5-98ab-bcac856b9ba8 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:48.404164 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-80a6dbd7-c3b5-41a5-98ab-bcac856b9ba8 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:48.411651 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80a6dbd7-c3b5-41a5-98ab-bcac856b9ba8 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:48.416803 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80a6dbd7-c3b5-41a5-98ab-bcac856b9ba8 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:48.418184 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80a6dbd7-c3b5-41a5-98ab-bcac856b9ba8 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:48.420227 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-7c9dd50a-8697-44e1-b8b7-c5d841a88556 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:48.425805 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80a6dbd7-c3b5-41a5-98ab-bcac856b9ba8 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:48.434481 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7c9dd50a-8697-44e1-b8b7-c5d841a88556 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1236 microversion: 2.1 time: 0.498370 Jan 05 14:59:48.435309 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 31/69] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:47 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1236 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:49.349501 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-80a6dbd7-c3b5-41a5-98ab-bcac856b9ba8 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:49.360296 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-80a6dbd7-c3b5-41a5-98ab-bcac856b9ba8 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.977420 Jan 05 14:59:49.379191 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 39/70] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:48 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:49.396357 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f78ac0a3-825b-411b-b913-84c6d8c9ecab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:49.397092 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f78ac0a3-825b-411b-b913-84c6d8c9ecab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:49.404434 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f78ac0a3-825b-411b-b913-84c6d8c9ecab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:49.410080 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f78ac0a3-825b-411b-b913-84c6d8c9ecab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:49.416329 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f78ac0a3-825b-411b-b913-84c6d8c9ecab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:49.416329 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f78ac0a3-825b-411b-b913-84c6d8c9ecab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:49.453426 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-52b4bee3-f909-49ef-809a-876cb2f3a90d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:49.454761 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-52b4bee3-f909-49ef-809a-876cb2f3a90d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:49.621552 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-52b4bee3-f909-49ef-809a-876cb2f3a90d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:49.630200 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-52b4bee3-f909-49ef-809a-876cb2f3a90d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1236 microversion: 2.1 time: 0.181725 Jan 05 14:59:49.642860 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 40/71] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:49 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1236 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 14:59:49.688795 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f78ac0a3-825b-411b-b913-84c6d8c9ecab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:49.701506 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f78ac0a3-825b-411b-b913-84c6d8c9ecab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1280 microversion: 2.1 time: 0.308568 Jan 05 14:59:49.704548 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 32/72] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:49 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1280 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:50.410059 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1d9d91dd-f6a2-4ea0-a3c8-01aa9ba9782e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:50.411732 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1d9d91dd-f6a2-4ea0-a3c8-01aa9ba9782e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:50.456897 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d9d91dd-f6a2-4ea0-a3c8-01aa9ba9782e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:50.471982 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d9d91dd-f6a2-4ea0-a3c8-01aa9ba9782e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:50.475112 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d9d91dd-f6a2-4ea0-a3c8-01aa9ba9782e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:50.479031 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d9d91dd-f6a2-4ea0-a3c8-01aa9ba9782e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:50.660278 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3dfa364a-5069-4add-803f-8330eb85352b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:50.668579 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3dfa364a-5069-4add-803f-8330eb85352b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:50.677629 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3dfa364a-5069-4add-803f-8330eb85352b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:50.678085 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3dfa364a-5069-4add-803f-8330eb85352b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:50.686665 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3dfa364a-5069-4add-803f-8330eb85352b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:50.693839 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3dfa364a-5069-4add-803f-8330eb85352b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:50.840934 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3dfa364a-5069-4add-803f-8330eb85352b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:50.861495 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3dfa364a-5069-4add-803f-8330eb85352b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1240 microversion: 2.1 time: 0.210473 Jan 05 14:59:50.870043 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 33/73] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:50 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1240 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:50.878667 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-0859baaf-4d67-4e90-bb59-f914fe08ceb5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:50.880096 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0859baaf-4d67-4e90-bb59-f914fe08ceb5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:50.887872 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0859baaf-4d67-4e90-bb59-f914fe08ceb5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:50.888459 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0859baaf-4d67-4e90-bb59-f914fe08ceb5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:50.889794 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0859baaf-4d67-4e90-bb59-f914fe08ceb5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:50.891143 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0859baaf-4d67-4e90-bb59-f914fe08ceb5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:50.915545 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1d9d91dd-f6a2-4ea0-a3c8-01aa9ba9782e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:50.925691 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1d9d91dd-f6a2-4ea0-a3c8-01aa9ba9782e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.530041 Jan 05 14:59:50.926379 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 41/74] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:50 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:51.043290 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-0859baaf-4d67-4e90-bb59-f914fe08ceb5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:51.050578 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-0859baaf-4d67-4e90-bb59-f914fe08ceb5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.177135 Jan 05 14:59:51.051149 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 34/75] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:50 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:51.878761 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-14e0582e-31b0-4484-a1e7-3f2b9e8ff122 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:51.879367 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-14e0582e-31b0-4484-a1e7-3f2b9e8ff122 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:51.897939 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14e0582e-31b0-4484-a1e7-3f2b9e8ff122 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:51.897939 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14e0582e-31b0-4484-a1e7-3f2b9e8ff122 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:51.897939 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14e0582e-31b0-4484-a1e7-3f2b9e8ff122 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:51.898191 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14e0582e-31b0-4484-a1e7-3f2b9e8ff122 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:51.944059 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-672d017b-65c7-4c32-94e2-808a1592bfe2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:51.944734 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-672d017b-65c7-4c32-94e2-808a1592bfe2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:51.956911 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-672d017b-65c7-4c32-94e2-808a1592bfe2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:51.960162 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-672d017b-65c7-4c32-94e2-808a1592bfe2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:51.962231 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-672d017b-65c7-4c32-94e2-808a1592bfe2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:51.969783 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-672d017b-65c7-4c32-94e2-808a1592bfe2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:52.071239 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-14e0582e-31b0-4484-a1e7-3f2b9e8ff122 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:52.080701 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-14e0582e-31b0-4484-a1e7-3f2b9e8ff122 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1288 microversion: 2.1 time: 0.205513 Jan 05 14:59:52.086280 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 42/76] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:51 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1288 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:52.098840 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dd82f33e-c18d-4471-8279-89efd71de7f9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:52.100941 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dd82f33e-c18d-4471-8279-89efd71de7f9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:52.111379 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd82f33e-c18d-4471-8279-89efd71de7f9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:52.113452 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd82f33e-c18d-4471-8279-89efd71de7f9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:52.116582 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd82f33e-c18d-4471-8279-89efd71de7f9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:52.118470 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd82f33e-c18d-4471-8279-89efd71de7f9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:52.501104 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-672d017b-65c7-4c32-94e2-808a1592bfe2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:52.518773 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-672d017b-65c7-4c32-94e2-808a1592bfe2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.578682 Jan 05 14:59:52.528717 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 35/77] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:51 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:52.714409 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-a29c664b-2b9f-4817-9471-e3c87169e13b req-22f1f9b9-1c66-44ae-8f16-937f6872eec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e27001d-6fb2-4283-b4e6-19f0aec6d3cb", "tag": "7e97ea9f-9968-4d12-a26d-c48d64741cea"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:59:52.714409 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:52.714409 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 14:59:52.721441 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-a29c664b-2b9f-4817-9471-e3c87169e13b req-22f1f9b9-1c66-44ae-8f16-937f6872eec0 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:52.722074 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-a29c664b-2b9f-4817-9471-e3c87169e13b req-22f1f9b9-1c66-44ae-8f16-937f6872eec0 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:52.733770 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-dd82f33e-c18d-4471-8279-89efd71de7f9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:52.747104 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dd82f33e-c18d-4471-8279-89efd71de7f9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.655227 Jan 05 14:59:52.748436 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 43/78] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:52 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:52.749389 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-a29c664b-2b9f-4817-9471-e3c87169e13b req-22f1f9b9-1c66-44ae-8f16-937f6872eec0 service nova] Creating event network-changed:7e97ea9f-9968-4d12-a26d-c48d64741cea for instance 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb on hv-cinder-maste Jan 05 14:59:52.754785 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-a29c664b-2b9f-4817-9471-e3c87169e13b req-22f1f9b9-1c66-44ae-8f16-937f6872eec0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232471 Jan 05 14:59:52.755541 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 36/79] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 14:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:52.772505 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-bf456769-4696-45e5-8638-88499e07b687 req-500cc71f-b44e-4053-8ebe-043fce94dfd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f4ef43-fb41-48ea-a380-e03f6fccf9c5", "tag": "94077c14-de44-48f3-8ca4-3b1be238b708"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:59:52.775343 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:52.775343 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 14:59:52.795093 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bf456769-4696-45e5-8638-88499e07b687 req-500cc71f-b44e-4053-8ebe-043fce94dfd5 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:52.795854 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bf456769-4696-45e5-8638-88499e07b687 req-500cc71f-b44e-4053-8ebe-043fce94dfd5 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:52.821757 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-bf456769-4696-45e5-8638-88499e07b687 req-500cc71f-b44e-4053-8ebe-043fce94dfd5 service nova] Creating event network-changed:94077c14-de44-48f3-8ca4-3b1be238b708 for instance 67f4ef43-fb41-48ea-a380-e03f6fccf9c5 on hv-cinder-maste Jan 05 14:59:52.822312 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bf456769-4696-45e5-8638-88499e07b687 req-500cc71f-b44e-4053-8ebe-043fce94dfd5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 05 14:59:52.823523 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d103cd80-61d6-4e7e-b9ab-7aa6c3d31992 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:52.824114 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d103cd80-61d6-4e7e-b9ab-7aa6c3d31992 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:52.825132 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d103cd80-61d6-4e7e-b9ab-7aa6c3d31992 None None] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:52.838787 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d103cd80-61d6-4e7e-b9ab-7aa6c3d31992 None None] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:52.864779 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.compute.rpcapi [None req-d103cd80-61d6-4e7e-b9ab-7aa6c3d31992 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 05 14:59:52.866045 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d103cd80-61d6-4e7e-b9ab-7aa6c3d31992 None None] Releasing lock "compute-rpcapi-router" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 05 14:59:52.885208 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d103cd80-61d6-4e7e-b9ab-7aa6c3d31992 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117488 Jan 05 14:59:52.887030 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 44/80] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 14:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:53.103969 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f75856bc-3791-4c2c-8b93-9fe593e09225 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:53.105670 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f75856bc-3791-4c2c-8b93-9fe593e09225 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:53.112181 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f75856bc-3791-4c2c-8b93-9fe593e09225 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:53.112789 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f75856bc-3791-4c2c-8b93-9fe593e09225 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:53.113916 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f75856bc-3791-4c2c-8b93-9fe593e09225 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:53.114609 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f75856bc-3791-4c2c-8b93-9fe593e09225 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:53.223747 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f75856bc-3791-4c2c-8b93-9fe593e09225 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:53.231573 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f75856bc-3791-4c2c-8b93-9fe593e09225 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1294 microversion: 2.1 time: 0.132449 Jan 05 14:59:53.232810 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 37/81] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:53 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1294 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:53.536572 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-20c46c97-9f7a-4c78-adef-3021654624a1 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:53.537511 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-20c46c97-9f7a-4c78-adef-3021654624a1 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:53.550144 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20c46c97-9f7a-4c78-adef-3021654624a1 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:53.550144 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20c46c97-9f7a-4c78-adef-3021654624a1 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:53.550144 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20c46c97-9f7a-4c78-adef-3021654624a1 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:53.550144 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20c46c97-9f7a-4c78-adef-3021654624a1 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:53.764235 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-fb28e40a-e499-4df9-8fc4-5a71f4c106e8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:53.765196 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-fb28e40a-e499-4df9-8fc4-5a71f4c106e8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:53.771252 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fb28e40a-e499-4df9-8fc4-5a71f4c106e8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:53.771882 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fb28e40a-e499-4df9-8fc4-5a71f4c106e8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:53.784546 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fb28e40a-e499-4df9-8fc4-5a71f4c106e8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:53.786512 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fb28e40a-e499-4df9-8fc4-5a71f4c106e8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:53.892158 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-20c46c97-9f7a-4c78-adef-3021654624a1 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:53.901378 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-20c46c97-9f7a-4c78-adef-3021654624a1 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.368720 Jan 05 14:59:53.902592 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 45/82] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:53 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:54.246512 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-fb28e40a-e499-4df9-8fc4-5a71f4c106e8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:54.257833 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-fb28e40a-e499-4df9-8fc4-5a71f4c106e8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.497690 Jan 05 14:59:54.258554 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b5e7c5f1-2b45-4642-8cf9-2bf4187ba65c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:54.259250 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b5e7c5f1-2b45-4642-8cf9-2bf4187ba65c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:54.259434 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 38/83] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:53 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 14:59:54.282462 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5e7c5f1-2b45-4642-8cf9-2bf4187ba65c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:54.283008 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5e7c5f1-2b45-4642-8cf9-2bf4187ba65c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:54.285501 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5e7c5f1-2b45-4642-8cf9-2bf4187ba65c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:54.285501 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5e7c5f1-2b45-4642-8cf9-2bf4187ba65c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:54.324943 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a5ce132e-5901-4f86-8bac-ea628ed1b598 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1180961299", "imageRef": "e4c11159-1e41-437a-af97-eb5f10704ae6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c375b41-1339-4d14-93e7-e473aa7e6978"}], "security_groups": [{"name": "tempest-securitygroup--1078732531"}], "key_name": "tempest-keypair-971799383", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:59:54.655131 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.network.neutron [None req-a5ce132e-5901-4f86-8bac-ea628ed1b598 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] validate_networks() for [('1c375b41-1339-4d14-93e7-e473aa7e6978', None, None, None, None, None)] {{(pid=128789) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 14:59:54.742080 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b5e7c5f1-2b45-4642-8cf9-2bf4187ba65c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:54.749972 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b5e7c5f1-2b45-4642-8cf9-2bf4187ba65c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.496068 Jan 05 14:59:54.757197 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 46/84] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:54 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 14:59:54.923074 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-485add66-b327-4b21-9466-b8ffdd84aa1c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:54.925596 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-485add66-b327-4b21-9466-b8ffdd84aa1c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:54.935927 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-485add66-b327-4b21-9466-b8ffdd84aa1c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:54.938189 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-485add66-b327-4b21-9466-b8ffdd84aa1c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:54.943860 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-485add66-b327-4b21-9466-b8ffdd84aa1c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:54.943860 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-485add66-b327-4b21-9466-b8ffdd84aa1c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:55.066254 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-a5ce132e-5901-4f86-8bac-ea628ed1b598 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Flavor limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 14:59:55.067509 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-a5ce132e-5901-4f86-8bac-ea628ed1b598 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Image limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 14:59:55.067980 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-a5ce132e-5901-4f86-8bac-ea628ed1b598 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Flavor pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 14:59:55.068381 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-a5ce132e-5901-4f86-8bac-ea628ed1b598 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Image pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 14:59:55.068788 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-a5ce132e-5901-4f86-8bac-ea628ed1b598 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 14:59:55.084045 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a5ce132e-5901-4f86-8bac-ea628ed1b598 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:55.084524 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a5ce132e-5901-4f86-8bac-ea628ed1b598 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:55.087665 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a5ce132e-5901-4f86-8bac-ea628ed1b598 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:55.094529 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a5ce132e-5901-4f86-8bac-ea628ed1b598 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:55.111489 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-a5ce132e-5901-4f86-8bac-ea628ed1b598 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Getting quotas for project f4a45a70c5d046238abaad07fbe529e9. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 14:59:55.116485 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-a5ce132e-5901-4f86-8bac-ea628ed1b598 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Getting quotas for user d43400b4646449ce94967ec5bab4eca1 and project f4a45a70c5d046238abaad07fbe529e9. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 14:59:55.129793 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a5ce132e-5901-4f86-8bac-ea628ed1b598 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Going to run 1 instances... {{(pid=128789) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 14:59:55.132090 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a5ce132e-5901-4f86-8bac-ea628ed1b598 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4c11159-1e41-437a-af97-eb5f10704ae6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 14:59:55.170836 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-485add66-b327-4b21-9466-b8ffdd84aa1c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:55.179475 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-485add66-b327-4b21-9466-b8ffdd84aa1c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.264809 Jan 05 14:59:55.180301 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 47/85] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:54 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:55.276533 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-da71097d-2255-42b5-b884-c6238886ac74 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:55.277171 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-da71097d-2255-42b5-b884-c6238886ac74 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:55.283510 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da71097d-2255-42b5-b884-c6238886ac74 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:55.283982 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da71097d-2255-42b5-b884-c6238886ac74 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:55.284751 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da71097d-2255-42b5-b884-c6238886ac74 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:55.285204 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da71097d-2255-42b5-b884-c6238886ac74 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:55.318161 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a5ce132e-5901-4f86-8bac-ea628ed1b598 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.997959 Jan 05 14:59:55.323847 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 39/86] 10.222.0.30 () {62 vars in 1187 bytes} [Wed Jan 5 14:59:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 05 14:59:55.328196 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a979983a-b7cc-4394-a254-4948b3b324b1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:55.328810 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a979983a-b7cc-4394-a254-4948b3b324b1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:55.384323 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a979983a-b7cc-4394-a254-4948b3b324b1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:55.397638 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a979983a-b7cc-4394-a254-4948b3b324b1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:55.399179 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a979983a-b7cc-4394-a254-4948b3b324b1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:55.400355 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a979983a-b7cc-4394-a254-4948b3b324b1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1281 microversion: 2.20 time: 0.075965 Jan 05 14:59:55.400943 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 40/87] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 14:59:55 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 14:59:55.447612 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-dc9d52d6-d0e9-49e9-84fa-973efb522cc7 req-223213b4-5406-463a-b4be-709151142195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3327c27f-a8e9-4b19-8041-fb5260278159", "tag": "2886de19-8aa3-470c-a593-9381bdb36ca0"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 14:59:55.450994 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.450994 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 14:59:55.465852 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-dc9d52d6-d0e9-49e9-84fa-973efb522cc7 req-223213b4-5406-463a-b4be-709151142195 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:55.466622 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-dc9d52d6-d0e9-49e9-84fa-973efb522cc7 req-223213b4-5406-463a-b4be-709151142195 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:55.495709 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-dc9d52d6-d0e9-49e9-84fa-973efb522cc7 req-223213b4-5406-463a-b4be-709151142195 service nova] Creating event network-changed:2886de19-8aa3-470c-a593-9381bdb36ca0 for instance 3327c27f-a8e9-4b19-8041-fb5260278159 on hv-cinder-maste Jan 05 14:59:55.505466 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-dc9d52d6-d0e9-49e9-84fa-973efb522cc7 req-223213b4-5406-463a-b4be-709151142195 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064356 Jan 05 14:59:55.506505 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 41/88] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 14:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 14:59:55.551842 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-da71097d-2255-42b5-b884-c6238886ac74 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:55.576037 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-da71097d-2255-42b5-b884-c6238886ac74 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.303087 Jan 05 14:59:55.576922 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 48/89] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:55 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 14:59:55.767744 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-0346f390-8886-4eae-bac0-c4ff4df6ae1b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:55.768435 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0346f390-8886-4eae-bac0-c4ff4df6ae1b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:55.774555 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0346f390-8886-4eae-bac0-c4ff4df6ae1b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:55.774998 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0346f390-8886-4eae-bac0-c4ff4df6ae1b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:55.775762 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0346f390-8886-4eae-bac0-c4ff4df6ae1b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:55.776249 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0346f390-8886-4eae-bac0-c4ff4df6ae1b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:55.908743 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-0346f390-8886-4eae-bac0-c4ff4df6ae1b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:55.915990 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-0346f390-8886-4eae-bac0-c4ff4df6ae1b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.152876 Jan 05 14:59:55.916735 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 42/90] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:55 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:56.195764 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-af34513a-7d43-46fc-bbd3-b23c07acb77c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:56.196377 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-af34513a-7d43-46fc-bbd3-b23c07acb77c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:56.202379 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af34513a-7d43-46fc-bbd3-b23c07acb77c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:56.203418 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af34513a-7d43-46fc-bbd3-b23c07acb77c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:56.204398 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af34513a-7d43-46fc-bbd3-b23c07acb77c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:56.204841 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af34513a-7d43-46fc-bbd3-b23c07acb77c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:56.339735 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-af34513a-7d43-46fc-bbd3-b23c07acb77c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:56.347062 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-af34513a-7d43-46fc-bbd3-b23c07acb77c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.155318 Jan 05 14:59:56.347626 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 49/91] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:56 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:56.419085 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a37a0e20-fc8b-4dff-8d9c-65447c68812f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:56.419645 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a37a0e20-fc8b-4dff-8d9c-65447c68812f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:56.469374 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a37a0e20-fc8b-4dff-8d9c-65447c68812f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:56.476283 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a37a0e20-fc8b-4dff-8d9c-65447c68812f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:56.477859 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a37a0e20-fc8b-4dff-8d9c-65447c68812f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:56.478949 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a37a0e20-fc8b-4dff-8d9c-65447c68812f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1281 microversion: 2.20 time: 0.063586 Jan 05 14:59:56.479506 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 43/92] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 14:59:56 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1281 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 14:59:56.592465 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0a076d6f-e508-4ead-953f-38639ad04e11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:56.593119 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0a076d6f-e508-4ead-953f-38639ad04e11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:56.598978 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a076d6f-e508-4ead-953f-38639ad04e11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:56.599420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a076d6f-e508-4ead-953f-38639ad04e11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:56.600195 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a076d6f-e508-4ead-953f-38639ad04e11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:56.600625 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a076d6f-e508-4ead-953f-38639ad04e11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:56.726820 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-0a076d6f-e508-4ead-953f-38639ad04e11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:56.734798 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0a076d6f-e508-4ead-953f-38639ad04e11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.145930 Jan 05 14:59:56.735508 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 50/93] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:56 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:56.931554 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-68fba021-9497-4ec6-8c39-20ffcd080ff1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:56.932160 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-68fba021-9497-4ec6-8c39-20ffcd080ff1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:56.938151 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-68fba021-9497-4ec6-8c39-20ffcd080ff1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:56.938589 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-68fba021-9497-4ec6-8c39-20ffcd080ff1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:56.939352 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-68fba021-9497-4ec6-8c39-20ffcd080ff1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:56.939780 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-68fba021-9497-4ec6-8c39-20ffcd080ff1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:57.065584 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-68fba021-9497-4ec6-8c39-20ffcd080ff1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:57.072689 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-68fba021-9497-4ec6-8c39-20ffcd080ff1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.144889 Jan 05 14:59:57.073277 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 44/94] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:56 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:57.364158 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0cc3b848-eb4a-4b0b-950f-6abf1501b25e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:57.365435 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0cc3b848-eb4a-4b0b-950f-6abf1501b25e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:57.371606 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cc3b848-eb4a-4b0b-950f-6abf1501b25e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:57.372051 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cc3b848-eb4a-4b0b-950f-6abf1501b25e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:57.372881 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cc3b848-eb4a-4b0b-950f-6abf1501b25e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:57.373346 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cc3b848-eb4a-4b0b-950f-6abf1501b25e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:57.499064 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3e0572e1-0ed2-4bea-b686-efe7e27e16c2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:57.501951 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3e0572e1-0ed2-4bea-b686-efe7e27e16c2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:57.521298 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3e0572e1-0ed2-4bea-b686-efe7e27e16c2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:57.528775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3e0572e1-0ed2-4bea-b686-efe7e27e16c2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:57.528775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3e0572e1-0ed2-4bea-b686-efe7e27e16c2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:57.528775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3e0572e1-0ed2-4bea-b686-efe7e27e16c2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:57.588462 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3e0572e1-0ed2-4bea-b686-efe7e27e16c2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:57.596533 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3e0572e1-0ed2-4bea-b686-efe7e27e16c2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:57.598801 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3e0572e1-0ed2-4bea-b686-efe7e27e16c2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:57.600056 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3e0572e1-0ed2-4bea-b686-efe7e27e16c2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1277 microversion: 2.20 time: 0.104801 Jan 05 14:59:57.601166 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 45/95] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 14:59:57 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1277 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 14:59:57.680173 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-0cc3b848-eb4a-4b0b-950f-6abf1501b25e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:57.687943 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0cc3b848-eb4a-4b0b-950f-6abf1501b25e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.327754 Jan 05 14:59:57.688631 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 51/96] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:57 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:57.750595 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-954294a9-c44f-4eab-9358-afaf7e9042c2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:57.751203 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-954294a9-c44f-4eab-9358-afaf7e9042c2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:57.757157 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-954294a9-c44f-4eab-9358-afaf7e9042c2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:57.757633 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-954294a9-c44f-4eab-9358-afaf7e9042c2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:57.758411 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-954294a9-c44f-4eab-9358-afaf7e9042c2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:57.758873 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-954294a9-c44f-4eab-9358-afaf7e9042c2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:57.902645 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-954294a9-c44f-4eab-9358-afaf7e9042c2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:57.910738 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-954294a9-c44f-4eab-9358-afaf7e9042c2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.163846 Jan 05 14:59:57.911309 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 46/97] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:57 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:58.089828 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f244623c-235e-46ab-8078-b72347875c28 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:58.090437 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f244623c-235e-46ab-8078-b72347875c28 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:58.100727 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f244623c-235e-46ab-8078-b72347875c28 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:58.101199 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f244623c-235e-46ab-8078-b72347875c28 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:58.101992 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f244623c-235e-46ab-8078-b72347875c28 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:58.102417 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f244623c-235e-46ab-8078-b72347875c28 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:58.231514 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-f244623c-235e-46ab-8078-b72347875c28 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:58.240182 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f244623c-235e-46ab-8078-b72347875c28 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.154355 Jan 05 14:59:58.240763 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 52/98] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:58 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:58.619166 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-73785481-e9aa-4caa-8b00-8aabe0c76d10 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:58.619872 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-73785481-e9aa-4caa-8b00-8aabe0c76d10 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:58.626464 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-73785481-e9aa-4caa-8b00-8aabe0c76d10 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:58.626904 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-73785481-e9aa-4caa-8b00-8aabe0c76d10 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:58.627805 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-73785481-e9aa-4caa-8b00-8aabe0c76d10 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:58.628603 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-73785481-e9aa-4caa-8b00-8aabe0c76d10 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:58.688772 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-73785481-e9aa-4caa-8b00-8aabe0c76d10 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:58.696794 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-73785481-e9aa-4caa-8b00-8aabe0c76d10 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:58.698380 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-73785481-e9aa-4caa-8b00-8aabe0c76d10 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:58.699478 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-73785481-e9aa-4caa-8b00-8aabe0c76d10 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1333 microversion: 2.20 time: 0.084465 Jan 05 14:59:58.700320 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 47/99] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 14:59:58 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1333 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 14:59:58.705697 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-93985268-489f-41bc-befa-dfc852e54bc3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:58.706887 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-93985268-489f-41bc-befa-dfc852e54bc3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:58.713961 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93985268-489f-41bc-befa-dfc852e54bc3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:58.714575 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93985268-489f-41bc-befa-dfc852e54bc3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:58.715420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93985268-489f-41bc-befa-dfc852e54bc3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:58.715916 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93985268-489f-41bc-befa-dfc852e54bc3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:58.848487 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-93985268-489f-41bc-befa-dfc852e54bc3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:58.856030 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-93985268-489f-41bc-befa-dfc852e54bc3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.154737 Jan 05 14:59:58.856606 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 53/100] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:58 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 14:59:58.927946 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ff11dbcc-742c-4083-981a-39720600d7aa tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:58.928639 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ff11dbcc-742c-4083-981a-39720600d7aa tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:58.934639 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ff11dbcc-742c-4083-981a-39720600d7aa tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:58.935090 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ff11dbcc-742c-4083-981a-39720600d7aa tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:58.944759 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ff11dbcc-742c-4083-981a-39720600d7aa tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:58.944759 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ff11dbcc-742c-4083-981a-39720600d7aa tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:59.066158 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ff11dbcc-742c-4083-981a-39720600d7aa tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:59.073564 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ff11dbcc-742c-4083-981a-39720600d7aa tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.149524 Jan 05 14:59:59.074140 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 48/101] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:58 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:59.257957 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2411fba3-31c0-4b26-9111-e2e710ccaeee tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:59.258631 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2411fba3-31c0-4b26-9111-e2e710ccaeee tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:59.264596 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2411fba3-31c0-4b26-9111-e2e710ccaeee tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:59.265051 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2411fba3-31c0-4b26-9111-e2e710ccaeee tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:59.265859 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2411fba3-31c0-4b26-9111-e2e710ccaeee tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:59.266293 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2411fba3-31c0-4b26-9111-e2e710ccaeee tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:59.396394 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-2411fba3-31c0-4b26-9111-e2e710ccaeee tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:59.403929 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2411fba3-31c0-4b26-9111-e2e710ccaeee tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.150124 Jan 05 14:59:59.404502 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 54/102] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:59 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 14:59:59.717226 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b7f7a9bd-d541-4b6a-810a-017be393df4b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:59.717829 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b7f7a9bd-d541-4b6a-810a-017be393df4b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:59.724300 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b7f7a9bd-d541-4b6a-810a-017be393df4b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:59.724743 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b7f7a9bd-d541-4b6a-810a-017be393df4b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:59.725537 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b7f7a9bd-d541-4b6a-810a-017be393df4b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:59.725969 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b7f7a9bd-d541-4b6a-810a-017be393df4b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:59.784136 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b7f7a9bd-d541-4b6a-810a-017be393df4b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:59.791734 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b7f7a9bd-d541-4b6a-810a-017be393df4b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:59.793331 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b7f7a9bd-d541-4b6a-810a-017be393df4b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 14:59:59.794425 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b7f7a9bd-d541-4b6a-810a-017be393df4b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1333 microversion: 2.20 time: 0.080884 Jan 05 14:59:59.794974 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 49/103] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 14:59:59 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1333 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 14:59:59.872366 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bb927abf-4b03-4965-89b8-c351ee816176 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 14:59:59.872970 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bb927abf-4b03-4965-89b8-c351ee816176 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 14:59:59.879704 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb927abf-4b03-4965-89b8-c351ee816176 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:59.880134 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb927abf-4b03-4965-89b8-c351ee816176 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:59:59.886692 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb927abf-4b03-4965-89b8-c351ee816176 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:59:59.886692 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb927abf-4b03-4965-89b8-c351ee816176 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:00.011493 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-bb927abf-4b03-4965-89b8-c351ee816176 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:00.019412 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bb927abf-4b03-4965-89b8-c351ee816176 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.150692 Jan 05 15:00:00.019965 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 55/104] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 14:59:59 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:00.090260 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-5d8360c8-21bf-4361-ac60-54437c9ddeb5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:00.090812 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-5d8360c8-21bf-4361-ac60-54437c9ddeb5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:00.096625 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5d8360c8-21bf-4361-ac60-54437c9ddeb5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:00.097095 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5d8360c8-21bf-4361-ac60-54437c9ddeb5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:00.097890 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5d8360c8-21bf-4361-ac60-54437c9ddeb5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:00.098326 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5d8360c8-21bf-4361-ac60-54437c9ddeb5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:00.226172 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-5d8360c8-21bf-4361-ac60-54437c9ddeb5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:00.233470 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-5d8360c8-21bf-4361-ac60-54437c9ddeb5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.146998 Jan 05 15:00:00.234525 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 50/105] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:00 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:00.419928 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4a8483c6-635a-4155-9cb3-a773123a07d9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:00.420621 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4a8483c6-635a-4155-9cb3-a773123a07d9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:00.427056 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a8483c6-635a-4155-9cb3-a773123a07d9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:00.427496 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a8483c6-635a-4155-9cb3-a773123a07d9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:00.428265 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a8483c6-635a-4155-9cb3-a773123a07d9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:00.428695 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a8483c6-635a-4155-9cb3-a773123a07d9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:00.652203 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4a8483c6-635a-4155-9cb3-a773123a07d9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:00.665869 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4a8483c6-635a-4155-9cb3-a773123a07d9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.248954 Jan 05 15:00:00.668490 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 56/106] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:00 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:00.812091 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-988fb539-bc7f-4948-8063-c2b2881c57d4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:00.812702 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-988fb539-bc7f-4948-8063-c2b2881c57d4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:00.818651 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-988fb539-bc7f-4948-8063-c2b2881c57d4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:00.819209 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-988fb539-bc7f-4948-8063-c2b2881c57d4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:00.819995 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-988fb539-bc7f-4948-8063-c2b2881c57d4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:00.820424 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-988fb539-bc7f-4948-8063-c2b2881c57d4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:00.883706 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-988fb539-bc7f-4948-8063-c2b2881c57d4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:00.899212 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-988fb539-bc7f-4948-8063-c2b2881c57d4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:00.900741 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-988fb539-bc7f-4948-8063-c2b2881c57d4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:00.901881 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-988fb539-bc7f-4948-8063-c2b2881c57d4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1333 microversion: 2.20 time: 0.093880 Jan 05 15:00:00.902451 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 51/107] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:00 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:00:01.037157 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-62da5366-1e13-4d78-8e94-673f11680fbe tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:01.037760 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-62da5366-1e13-4d78-8e94-673f11680fbe tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:01.045595 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62da5366-1e13-4d78-8e94-673f11680fbe tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:01.046033 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62da5366-1e13-4d78-8e94-673f11680fbe tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:01.051011 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62da5366-1e13-4d78-8e94-673f11680fbe tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:01.051011 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62da5366-1e13-4d78-8e94-673f11680fbe tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:01.178070 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-62da5366-1e13-4d78-8e94-673f11680fbe tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:01.185292 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-62da5366-1e13-4d78-8e94-673f11680fbe tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.151897 Jan 05 15:00:01.185848 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 57/108] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:01 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:01.250877 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ef31b39f-fb09-47a2-8cdc-4ea159b70dd1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:01.251512 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ef31b39f-fb09-47a2-8cdc-4ea159b70dd1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:01.257410 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ef31b39f-fb09-47a2-8cdc-4ea159b70dd1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:01.257863 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ef31b39f-fb09-47a2-8cdc-4ea159b70dd1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:01.258716 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ef31b39f-fb09-47a2-8cdc-4ea159b70dd1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:01.259095 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ef31b39f-fb09-47a2-8cdc-4ea159b70dd1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:01.389954 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ef31b39f-fb09-47a2-8cdc-4ea159b70dd1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:01.397159 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ef31b39f-fb09-47a2-8cdc-4ea159b70dd1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.150438 Jan 05 15:00:01.397719 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 52/109] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:01 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:01.685181 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2f091c4e-2ba9-4fb8-8fa4-1643d02260b0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:01.685779 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2f091c4e-2ba9-4fb8-8fa4-1643d02260b0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:01.691696 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f091c4e-2ba9-4fb8-8fa4-1643d02260b0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:01.692135 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f091c4e-2ba9-4fb8-8fa4-1643d02260b0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:01.692904 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f091c4e-2ba9-4fb8-8fa4-1643d02260b0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:01.693356 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f091c4e-2ba9-4fb8-8fa4-1643d02260b0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:01.820731 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-2f091c4e-2ba9-4fb8-8fa4-1643d02260b0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:01.828677 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2f091c4e-2ba9-4fb8-8fa4-1643d02260b0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.147238 Jan 05 15:00:01.829271 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 58/110] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:01 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:01.920386 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f67d0f2e-2101-4ba6-bbf8-35ec17d78851 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:01.921233 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f67d0f2e-2101-4ba6-bbf8-35ec17d78851 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:01.927198 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f67d0f2e-2101-4ba6-bbf8-35ec17d78851 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:01.932998 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f67d0f2e-2101-4ba6-bbf8-35ec17d78851 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:01.932998 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f67d0f2e-2101-4ba6-bbf8-35ec17d78851 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:01.932998 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f67d0f2e-2101-4ba6-bbf8-35ec17d78851 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:01.986486 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f67d0f2e-2101-4ba6-bbf8-35ec17d78851 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:01.994074 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f67d0f2e-2101-4ba6-bbf8-35ec17d78851 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:01.995574 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f67d0f2e-2101-4ba6-bbf8-35ec17d78851 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:01.996657 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f67d0f2e-2101-4ba6-bbf8-35ec17d78851 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1341 microversion: 2.20 time: 0.080048 Jan 05 15:00:01.997233 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 53/111] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:01 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1341 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:00:02.201809 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8fba8c8f-1af2-4682-91b7-6860bd947011 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:02.203030 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8fba8c8f-1af2-4682-91b7-6860bd947011 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:02.208827 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fba8c8f-1af2-4682-91b7-6860bd947011 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:02.209311 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fba8c8f-1af2-4682-91b7-6860bd947011 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:02.210083 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fba8c8f-1af2-4682-91b7-6860bd947011 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:02.210510 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fba8c8f-1af2-4682-91b7-6860bd947011 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:02.335283 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8fba8c8f-1af2-4682-91b7-6860bd947011 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:02.342443 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8fba8c8f-1af2-4682-91b7-6860bd947011 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.144205 Jan 05 15:00:02.343031 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 59/112] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:02 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:02.413609 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d311d5fb-a746-4a28-b9a8-47e678b6eecb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:02.414210 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d311d5fb-a746-4a28-b9a8-47e678b6eecb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:02.419978 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d311d5fb-a746-4a28-b9a8-47e678b6eecb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:02.420419 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d311d5fb-a746-4a28-b9a8-47e678b6eecb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:02.421782 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d311d5fb-a746-4a28-b9a8-47e678b6eecb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:02.422213 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d311d5fb-a746-4a28-b9a8-47e678b6eecb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:02.547675 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d311d5fb-a746-4a28-b9a8-47e678b6eecb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:02.555308 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d311d5fb-a746-4a28-b9a8-47e678b6eecb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.145347 Jan 05 15:00:02.555865 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 54/113] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:02 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:02.845510 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a1bebf94-1ac4-49f2-9b9b-f193c5b0c606 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:02.846216 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a1bebf94-1ac4-49f2-9b9b-f193c5b0c606 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:02.851970 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1bebf94-1ac4-49f2-9b9b-f193c5b0c606 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:02.857911 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1bebf94-1ac4-49f2-9b9b-f193c5b0c606 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:02.857911 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1bebf94-1ac4-49f2-9b9b-f193c5b0c606 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:02.857911 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1bebf94-1ac4-49f2-9b9b-f193c5b0c606 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:02.982245 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a1bebf94-1ac4-49f2-9b9b-f193c5b0c606 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:02.990126 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a1bebf94-1ac4-49f2-9b9b-f193c5b0c606 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.148716 Jan 05 15:00:02.990688 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 60/114] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:02 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:03.015401 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-0983a639-2357-40ee-95ca-bd7d602e15d5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:03.016003 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0983a639-2357-40ee-95ca-bd7d602e15d5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:03.021783 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0983a639-2357-40ee-95ca-bd7d602e15d5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:03.022222 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0983a639-2357-40ee-95ca-bd7d602e15d5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:03.023001 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0983a639-2357-40ee-95ca-bd7d602e15d5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:03.023428 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0983a639-2357-40ee-95ca-bd7d602e15d5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:03.083399 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-0983a639-2357-40ee-95ca-bd7d602e15d5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:03.091050 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-0983a639-2357-40ee-95ca-bd7d602e15d5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:03.092569 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-0983a639-2357-40ee-95ca-bd7d602e15d5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:03.094179 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-0983a639-2357-40ee-95ca-bd7d602e15d5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1341 microversion: 2.20 time: 0.082482 Jan 05 15:00:03.094729 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 55/115] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:03 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1341 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:00:03.358843 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5dae5048-041c-4bf8-a611-d27a154c7fe0 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:03.359442 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5dae5048-041c-4bf8-a611-d27a154c7fe0 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:03.365472 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5dae5048-041c-4bf8-a611-d27a154c7fe0 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:03.365910 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5dae5048-041c-4bf8-a611-d27a154c7fe0 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:03.366678 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5dae5048-041c-4bf8-a611-d27a154c7fe0 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:03.367099 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5dae5048-041c-4bf8-a611-d27a154c7fe0 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:03.554395 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-5dae5048-041c-4bf8-a611-d27a154c7fe0 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:03.562414 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5dae5048-041c-4bf8-a611-d27a154c7fe0 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.207196 Jan 05 15:00:03.562984 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 61/116] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:03 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:03.576178 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-029ad1a6-87f7-4b2d-82eb-3399fcb4f5f7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:03.576795 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-029ad1a6-87f7-4b2d-82eb-3399fcb4f5f7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:03.582670 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-029ad1a6-87f7-4b2d-82eb-3399fcb4f5f7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:03.583118 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-029ad1a6-87f7-4b2d-82eb-3399fcb4f5f7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:03.583899 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-029ad1a6-87f7-4b2d-82eb-3399fcb4f5f7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:03.584327 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-029ad1a6-87f7-4b2d-82eb-3399fcb4f5f7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:03.712422 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-029ad1a6-87f7-4b2d-82eb-3399fcb4f5f7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:03.720476 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-029ad1a6-87f7-4b2d-82eb-3399fcb4f5f7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.147870 Jan 05 15:00:03.721177 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 56/117] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:03 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:04.005874 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d55d01a3-56dd-4a80-86d5-d4afc9bf4099 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:04.006489 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d55d01a3-56dd-4a80-86d5-d4afc9bf4099 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:04.012181 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d55d01a3-56dd-4a80-86d5-d4afc9bf4099 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:04.012629 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d55d01a3-56dd-4a80-86d5-d4afc9bf4099 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:04.013442 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d55d01a3-56dd-4a80-86d5-d4afc9bf4099 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:04.013880 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d55d01a3-56dd-4a80-86d5-d4afc9bf4099 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:04.112246 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a1e54213-b8f2-4c1c-a670-ed344a8945af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:04.112839 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a1e54213-b8f2-4c1c-a670-ed344a8945af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:04.119015 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a1e54213-b8f2-4c1c-a670-ed344a8945af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:04.119462 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a1e54213-b8f2-4c1c-a670-ed344a8945af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:04.120240 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a1e54213-b8f2-4c1c-a670-ed344a8945af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:04.120719 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a1e54213-b8f2-4c1c-a670-ed344a8945af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:04.192555 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a1e54213-b8f2-4c1c-a670-ed344a8945af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:04.192555 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a1e54213-b8f2-4c1c-a670-ed344a8945af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:04.193625 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a1e54213-b8f2-4c1c-a670-ed344a8945af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:04.194957 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a1e54213-b8f2-4c1c-a670-ed344a8945af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1339 microversion: 2.20 time: 0.087003 Jan 05 15:00:04.195708 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 57/118] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:04 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1339 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:00:04.224406 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d55d01a3-56dd-4a80-86d5-d4afc9bf4099 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:04.244705 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d55d01a3-56dd-4a80-86d5-d4afc9bf4099 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.230543 Jan 05 15:00:04.244705 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 62/119] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:04 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:04.579127 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-8875b2a9-b3f7-49b8-b9d5-f4d934a62c50 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:04.580014 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-8875b2a9-b3f7-49b8-b9d5-f4d934a62c50 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:04.587075 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8875b2a9-b3f7-49b8-b9d5-f4d934a62c50 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:04.587518 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8875b2a9-b3f7-49b8-b9d5-f4d934a62c50 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:04.588299 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8875b2a9-b3f7-49b8-b9d5-f4d934a62c50 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:04.588724 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8875b2a9-b3f7-49b8-b9d5-f4d934a62c50 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:04.719283 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-8875b2a9-b3f7-49b8-b9d5-f4d934a62c50 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:04.726503 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-8875b2a9-b3f7-49b8-b9d5-f4d934a62c50 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.151192 Jan 05 15:00:04.727261 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 58/120] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:04 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:04.737243 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f071b81e-e853-4e89-bf28-c56d89078c15 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:04.759547 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f071b81e-e853-4e89-bf28-c56d89078c15 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:04.759547 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f071b81e-e853-4e89-bf28-c56d89078c15 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:04.759547 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f071b81e-e853-4e89-bf28-c56d89078c15 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:04.759547 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f071b81e-e853-4e89-bf28-c56d89078c15 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:04.760622 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f071b81e-e853-4e89-bf28-c56d89078c15 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:04.931839 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-f071b81e-e853-4e89-bf28-c56d89078c15 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:04.940127 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f071b81e-e853-4e89-bf28-c56d89078c15 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.206678 Jan 05 15:00:04.940912 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 63/121] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:04 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:05.215706 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7ab55c72-fd43-482a-89e5-01e32e00a15a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:05.216986 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7ab55c72-fd43-482a-89e5-01e32e00a15a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:05.224627 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7ab55c72-fd43-482a-89e5-01e32e00a15a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:05.225363 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7ab55c72-fd43-482a-89e5-01e32e00a15a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:05.226395 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7ab55c72-fd43-482a-89e5-01e32e00a15a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:05.227027 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7ab55c72-fd43-482a-89e5-01e32e00a15a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:05.261569 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bb5f181e-9177-4b5b-bd69-1d4b982e542c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:05.262502 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bb5f181e-9177-4b5b-bd69-1d4b982e542c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:05.272983 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb5f181e-9177-4b5b-bd69-1d4b982e542c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:05.273609 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb5f181e-9177-4b5b-bd69-1d4b982e542c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:05.274495 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb5f181e-9177-4b5b-bd69-1d4b982e542c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:05.276643 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb5f181e-9177-4b5b-bd69-1d4b982e542c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:05.406619 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-7ab55c72-fd43-482a-89e5-01e32e00a15a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:05.418563 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-7ab55c72-fd43-482a-89e5-01e32e00a15a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:05.420522 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-7ab55c72-fd43-482a-89e5-01e32e00a15a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:05.422468 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7ab55c72-fd43-482a-89e5-01e32e00a15a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1407 microversion: 2.20 time: 0.210567 Jan 05 15:00:05.424641 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 59/122] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:05 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:00:05.592578 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-bb5f181e-9177-4b5b-bd69-1d4b982e542c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:05.601973 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bb5f181e-9177-4b5b-bd69-1d4b982e542c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.345950 Jan 05 15:00:05.605857 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 64/123] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:05 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:05.744279 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2da80caa-815a-41b1-9ae2-5905a2725827 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:05.745291 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2da80caa-815a-41b1-9ae2-5905a2725827 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:05.753777 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2da80caa-815a-41b1-9ae2-5905a2725827 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:05.754220 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2da80caa-815a-41b1-9ae2-5905a2725827 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:05.760178 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2da80caa-815a-41b1-9ae2-5905a2725827 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:05.760794 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2da80caa-815a-41b1-9ae2-5905a2725827 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:05.908470 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-2da80caa-815a-41b1-9ae2-5905a2725827 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:05.920195 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2da80caa-815a-41b1-9ae2-5905a2725827 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.179837 Jan 05 15:00:05.922788 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 60/124] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:05 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:05.956802 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8674127d-c377-4e2f-b0ae-c28448b28b10 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:05.957615 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8674127d-c377-4e2f-b0ae-c28448b28b10 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:05.966026 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8674127d-c377-4e2f-b0ae-c28448b28b10 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:05.966573 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8674127d-c377-4e2f-b0ae-c28448b28b10 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:05.967678 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8674127d-c377-4e2f-b0ae-c28448b28b10 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:05.969240 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8674127d-c377-4e2f-b0ae-c28448b28b10 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:06.217803 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-e88f6e8f-fb47-49f1-a289-f6ac15bd0d22 req-39aedaab-c24c-4c5a-b3b7-b5440483a713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:06.217803 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:06.217803 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:00:06.217803 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-e88f6e8f-fb47-49f1-a289-f6ac15bd0d22 req-39aedaab-c24c-4c5a-b3b7-b5440483a713 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:06.217803 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-e88f6e8f-fb47-49f1-a289-f6ac15bd0d22 req-39aedaab-c24c-4c5a-b3b7-b5440483a713 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:06.226399 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-e88f6e8f-fb47-49f1-a289-f6ac15bd0d22 req-39aedaab-c24c-4c5a-b3b7-b5440483a713 service nova] Creating event network-changed:45483c3c-9f42-4aff-a962-22ff36647afc for instance 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 on hv-cinder-maste Jan 05 15:00:06.236745 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-e88f6e8f-fb47-49f1-a289-f6ac15bd0d22 req-39aedaab-c24c-4c5a-b3b7-b5440483a713 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063674 Jan 05 15:00:06.240433 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 61/125] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:00:06.303290 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8674127d-c377-4e2f-b0ae-c28448b28b10 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:06.325807 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8674127d-c377-4e2f-b0ae-c28448b28b10 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.361763 Jan 05 15:00:06.325807 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 65/126] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:05 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:06.443491 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0cfbd485-bc90-4f16-81d8-fc65c4da36f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:06.444541 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0cfbd485-bc90-4f16-81d8-fc65c4da36f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:06.452024 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cfbd485-bc90-4f16-81d8-fc65c4da36f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:06.452971 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cfbd485-bc90-4f16-81d8-fc65c4da36f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:06.454021 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cfbd485-bc90-4f16-81d8-fc65c4da36f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:06.454777 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cfbd485-bc90-4f16-81d8-fc65c4da36f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:06.529796 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-dd4e436e-5fcb-4790-8ce4-934eed04d64f req-e51bf56e-6f96-4c3b-9588-319b17f8a7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e27001d-6fb2-4283-b4e6-19f0aec6d3cb", "name": "network-vif-plugged", "status": "completed", "tag": "7e97ea9f-9968-4d12-a26d-c48d64741cea"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:06.532307 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:06.532307 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:00:06.573199 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-dd4e436e-5fcb-4790-8ce4-934eed04d64f req-e51bf56e-6f96-4c3b-9588-319b17f8a7d3 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:06.573199 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-dd4e436e-5fcb-4790-8ce4-934eed04d64f req-e51bf56e-6f96-4c3b-9588-319b17f8a7d3 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:06.573199 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-dd4e436e-5fcb-4790-8ce4-934eed04d64f req-e51bf56e-6f96-4c3b-9588-319b17f8a7d3 service nova] Creating event network-vif-plugged:7e97ea9f-9968-4d12-a26d-c48d64741cea for instance 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb on hv-cinder-maste Jan 05 15:00:06.573199 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-dd4e436e-5fcb-4790-8ce4-934eed04d64f req-e51bf56e-6f96-4c3b-9588-319b17f8a7d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138867 Jan 05 15:00:06.573199 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 62/127] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:00:06.625712 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1ef43702-b270-4b87-a951-5fbbcc2ab6e9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:06.626609 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1ef43702-b270-4b87-a951-5fbbcc2ab6e9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:06.634118 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1ef43702-b270-4b87-a951-5fbbcc2ab6e9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:06.634566 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1ef43702-b270-4b87-a951-5fbbcc2ab6e9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:06.635612 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1ef43702-b270-4b87-a951-5fbbcc2ab6e9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:06.636829 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1ef43702-b270-4b87-a951-5fbbcc2ab6e9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:06.759552 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-0cfbd485-bc90-4f16-81d8-fc65c4da36f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:06.768950 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-0cfbd485-bc90-4f16-81d8-fc65c4da36f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:06.773038 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-0cfbd485-bc90-4f16-81d8-fc65c4da36f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:06.773038 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0cfbd485-bc90-4f16-81d8-fc65c4da36f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1407 microversion: 2.20 time: 0.333574 Jan 05 15:00:06.773038 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 66/128] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:06 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:00:06.812706 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-1ef43702-b270-4b87-a951-5fbbcc2ab6e9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:06.820522 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1ef43702-b270-4b87-a951-5fbbcc2ab6e9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.202108 Jan 05 15:00:06.821244 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 63/129] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:06 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:06.944671 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d475d064-975d-473f-8ab5-beff8cd105b3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:06.956781 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d475d064-975d-473f-8ab5-beff8cd105b3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:06.973651 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d475d064-975d-473f-8ab5-beff8cd105b3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:06.974930 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d475d064-975d-473f-8ab5-beff8cd105b3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:06.977469 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d475d064-975d-473f-8ab5-beff8cd105b3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:06.978571 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d475d064-975d-473f-8ab5-beff8cd105b3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:07.254700 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d475d064-975d-473f-8ab5-beff8cd105b3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:07.262195 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d475d064-975d-473f-8ab5-beff8cd105b3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.327459 Jan 05 15:00:07.270097 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 67/130] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:06 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:07.335719 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-cad3390b-f47b-4d33-a8cc-1e6e74639dec tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:07.336334 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-cad3390b-f47b-4d33-a8cc-1e6e74639dec tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:07.343046 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cad3390b-f47b-4d33-a8cc-1e6e74639dec tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:07.343742 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cad3390b-f47b-4d33-a8cc-1e6e74639dec tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:07.344745 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cad3390b-f47b-4d33-a8cc-1e6e74639dec tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:07.345404 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cad3390b-f47b-4d33-a8cc-1e6e74639dec tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:07.502477 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-cad3390b-f47b-4d33-a8cc-1e6e74639dec tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:07.506587 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-cad3390b-f47b-4d33-a8cc-1e6e74639dec tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.174770 Jan 05 15:00:07.507675 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 64/131] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:07 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:07.789551 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e31d5198-b121-4bb0-9e99-2ac8bf8bfd6d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:07.790166 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e31d5198-b121-4bb0-9e99-2ac8bf8bfd6d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:07.796071 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e31d5198-b121-4bb0-9e99-2ac8bf8bfd6d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:07.796519 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e31d5198-b121-4bb0-9e99-2ac8bf8bfd6d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:07.797319 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e31d5198-b121-4bb0-9e99-2ac8bf8bfd6d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:07.797769 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e31d5198-b121-4bb0-9e99-2ac8bf8bfd6d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:07.837662 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-49ab7431-f96d-4171-aa0c-873bef7bb7b8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:07.838280 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-49ab7431-f96d-4171-aa0c-873bef7bb7b8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:07.845132 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-49ab7431-f96d-4171-aa0c-873bef7bb7b8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:07.845588 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-49ab7431-f96d-4171-aa0c-873bef7bb7b8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:07.846384 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-49ab7431-f96d-4171-aa0c-873bef7bb7b8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:07.846820 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-49ab7431-f96d-4171-aa0c-873bef7bb7b8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:07.950335 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e31d5198-b121-4bb0-9e99-2ac8bf8bfd6d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:07.959725 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e31d5198-b121-4bb0-9e99-2ac8bf8bfd6d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:07.961765 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e31d5198-b121-4bb0-9e99-2ac8bf8bfd6d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:07.973506 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e31d5198-b121-4bb0-9e99-2ac8bf8bfd6d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1407 microversion: 2.20 time: 0.177020 Jan 05 15:00:07.973506 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 68/132] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:07 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:00:08.008022 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-49ab7431-f96d-4171-aa0c-873bef7bb7b8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:08.017766 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-49ab7431-f96d-4171-aa0c-873bef7bb7b8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.183849 Jan 05 15:00:08.029748 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 65/133] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:07 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:08.279275 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-02b6ab9d-b807-43c2-bcab-7cdec91148cf tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:08.279982 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-02b6ab9d-b807-43c2-bcab-7cdec91148cf tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:08.286569 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02b6ab9d-b807-43c2-bcab-7cdec91148cf tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:08.287611 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02b6ab9d-b807-43c2-bcab-7cdec91148cf tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:08.288088 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02b6ab9d-b807-43c2-bcab-7cdec91148cf tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:08.288522 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02b6ab9d-b807-43c2-bcab-7cdec91148cf tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:08.426264 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-02b6ab9d-b807-43c2-bcab-7cdec91148cf tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:08.442622 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-02b6ab9d-b807-43c2-bcab-7cdec91148cf tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.166906 Jan 05 15:00:08.443261 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 69/134] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:08 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:08.523002 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-dec717f3-c0ec-47c0-b3ff-c47c8fa779dd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:08.523800 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-dec717f3-c0ec-47c0-b3ff-c47c8fa779dd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:08.530634 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-dec717f3-c0ec-47c0-b3ff-c47c8fa779dd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:08.531077 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-dec717f3-c0ec-47c0-b3ff-c47c8fa779dd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:08.531996 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-dec717f3-c0ec-47c0-b3ff-c47c8fa779dd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:08.532483 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-dec717f3-c0ec-47c0-b3ff-c47c8fa779dd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:08.614701 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-91f009f6-d8ff-4089-ba31-1a7c8934803c req-0feab5c9-3e0f-416e-8e78-47910d27d256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf86612-a721-4032-9b56-b9828fc658cd", "name": "network-vif-plugged", "status": "completed", "tag": "a1de646c-827f-41ad-bab9-8457e33db96d"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:08.616318 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:08.616318 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:00:08.623215 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-91f009f6-d8ff-4089-ba31-1a7c8934803c req-0feab5c9-3e0f-416e-8e78-47910d27d256 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:08.623717 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-91f009f6-d8ff-4089-ba31-1a7c8934803c req-0feab5c9-3e0f-416e-8e78-47910d27d256 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:08.635884 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-91f009f6-d8ff-4089-ba31-1a7c8934803c req-0feab5c9-3e0f-416e-8e78-47910d27d256 service nova] Creating event network-vif-plugged:a1de646c-827f-41ad-bab9-8457e33db96d for instance 6cf86612-a721-4032-9b56-b9828fc658cd on hv-cinder-maste Jan 05 15:00:08.640978 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-91f009f6-d8ff-4089-ba31-1a7c8934803c req-0feab5c9-3e0f-416e-8e78-47910d27d256 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029952 Jan 05 15:00:08.641633 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 70/135] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:00:08.666854 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-dec717f3-c0ec-47c0-b3ff-c47c8fa779dd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:08.674661 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-dec717f3-c0ec-47c0-b3ff-c47c8fa779dd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.155494 Jan 05 15:00:08.675220 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 66/136] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:08 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:08.981702 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3e0b1c1b-9c49-466c-af5d-3b4b9293e621 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:08.982671 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3e0b1c1b-9c49-466c-af5d-3b4b9293e621 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:08.990211 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e0b1c1b-9c49-466c-af5d-3b4b9293e621 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:08.990947 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e0b1c1b-9c49-466c-af5d-3b4b9293e621 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:08.992564 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e0b1c1b-9c49-466c-af5d-3b4b9293e621 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:08.993429 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e0b1c1b-9c49-466c-af5d-3b4b9293e621 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:09.034525 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-5824cbfc-878b-47fc-b771-7ea376dc5a82 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:09.035272 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-5824cbfc-878b-47fc-b771-7ea376dc5a82 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:09.041509 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5824cbfc-878b-47fc-b771-7ea376dc5a82 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:09.042057 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5824cbfc-878b-47fc-b771-7ea376dc5a82 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:09.042922 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5824cbfc-878b-47fc-b771-7ea376dc5a82 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:09.043338 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5824cbfc-878b-47fc-b771-7ea376dc5a82 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:09.136877 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3e0b1c1b-9c49-466c-af5d-3b4b9293e621 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:09.148099 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3e0b1c1b-9c49-466c-af5d-3b4b9293e621 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:09.148099 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3e0b1c1b-9c49-466c-af5d-3b4b9293e621 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:09.149748 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3e0b1c1b-9c49-466c-af5d-3b4b9293e621 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1407 microversion: 2.20 time: 0.172459 Jan 05 15:00:09.150434 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 71/137] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:08 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:00:09.210683 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-5824cbfc-878b-47fc-b771-7ea376dc5a82 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:09.218203 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-5824cbfc-878b-47fc-b771-7ea376dc5a82 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.187621 Jan 05 15:00:09.218801 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 67/138] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:09 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:09.459205 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1aa6e9f5-12ab-485b-9e04-d1684cc94d95 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:09.459811 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1aa6e9f5-12ab-485b-9e04-d1684cc94d95 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:09.465821 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aa6e9f5-12ab-485b-9e04-d1684cc94d95 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:09.466263 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aa6e9f5-12ab-485b-9e04-d1684cc94d95 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:09.467030 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aa6e9f5-12ab-485b-9e04-d1684cc94d95 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:09.467607 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aa6e9f5-12ab-485b-9e04-d1684cc94d95 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:09.653125 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1aa6e9f5-12ab-485b-9e04-d1684cc94d95 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:09.663645 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1aa6e9f5-12ab-485b-9e04-d1684cc94d95 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1315 microversion: 2.1 time: 0.207910 Jan 05 15:00:09.665054 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 72/139] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:09 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:09.693328 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-16d2ff21-5632-4403-97ae-e8533b52ec80 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:09.694736 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-16d2ff21-5632-4403-97ae-e8533b52ec80 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:09.702993 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-16d2ff21-5632-4403-97ae-e8533b52ec80 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:09.703798 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-16d2ff21-5632-4403-97ae-e8533b52ec80 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:09.705279 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-16d2ff21-5632-4403-97ae-e8533b52ec80 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:09.705961 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-16d2ff21-5632-4403-97ae-e8533b52ec80 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:09.871555 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-16d2ff21-5632-4403-97ae-e8533b52ec80 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:09.879528 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-16d2ff21-5632-4403-97ae-e8533b52ec80 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.189744 Jan 05 15:00:09.880105 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 68/140] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:09 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:10.168564 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-35b4baf9-f975-4d17-ae62-1e1eeb72801e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:10.168867 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-35b4baf9-f975-4d17-ae62-1e1eeb72801e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:10.175057 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35b4baf9-f975-4d17-ae62-1e1eeb72801e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:10.175809 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35b4baf9-f975-4d17-ae62-1e1eeb72801e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:10.180376 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35b4baf9-f975-4d17-ae62-1e1eeb72801e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:10.180376 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35b4baf9-f975-4d17-ae62-1e1eeb72801e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:10.235130 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-dc69e48f-b373-4547-a18a-4cce8eaced16 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:10.235750 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-dc69e48f-b373-4547-a18a-4cce8eaced16 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:10.242350 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-dc69e48f-b373-4547-a18a-4cce8eaced16 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:10.242615 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-dc69e48f-b373-4547-a18a-4cce8eaced16 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:10.244177 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-dc69e48f-b373-4547-a18a-4cce8eaced16 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:10.244622 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-dc69e48f-b373-4547-a18a-4cce8eaced16 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:10.347916 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-35b4baf9-f975-4d17-ae62-1e1eeb72801e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:10.359131 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-35b4baf9-f975-4d17-ae62-1e1eeb72801e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:10.365105 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-35b4baf9-f975-4d17-ae62-1e1eeb72801e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:10.368992 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-35b4baf9-f975-4d17-ae62-1e1eeb72801e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1407 microversion: 2.20 time: 0.204614 Jan 05 15:00:10.383102 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 73/141] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:10 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:00:10.456251 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-dc69e48f-b373-4547-a18a-4cce8eaced16 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:10.463875 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-dc69e48f-b373-4547-a18a-4cce8eaced16 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.232756 Jan 05 15:00:10.464439 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 69/142] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:10 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:10.655199 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-64e9cccb-b8a2-482c-9c96-2b9176d2a34b req-4cf5aca6-d1f6-44ed-99c7-239490bba533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3327c27f-a8e9-4b19-8041-fb5260278159", "name": "network-vif-plugged", "status": "completed", "tag": "2886de19-8aa3-470c-a593-9381bdb36ca0"}, {"server_uuid": "67f4ef43-fb41-48ea-a380-e03f6fccf9c5", "name": "network-vif-plugged", "status": "completed", "tag": "94077c14-de44-48f3-8ca4-3b1be238b708"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:10.656921 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:10.656921 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:00:10.665364 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-64e9cccb-b8a2-482c-9c96-2b9176d2a34b req-4cf5aca6-d1f6-44ed-99c7-239490bba533 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:10.665798 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-64e9cccb-b8a2-482c-9c96-2b9176d2a34b req-4cf5aca6-d1f6-44ed-99c7-239490bba533 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:10.685922 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-cda39dd6-5d83-43ff-80d0-7751aa967ba9 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:10.685922 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-cda39dd6-5d83-43ff-80d0-7751aa967ba9 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:10.692199 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cda39dd6-5d83-43ff-80d0-7751aa967ba9 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:10.692632 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cda39dd6-5d83-43ff-80d0-7751aa967ba9 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:10.693800 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cda39dd6-5d83-43ff-80d0-7751aa967ba9 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:10.694274 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cda39dd6-5d83-43ff-80d0-7751aa967ba9 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:10.700714 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-64e9cccb-b8a2-482c-9c96-2b9176d2a34b req-4cf5aca6-d1f6-44ed-99c7-239490bba533 service nova] Creating event network-vif-plugged:2886de19-8aa3-470c-a593-9381bdb36ca0 for instance 3327c27f-a8e9-4b19-8041-fb5260278159 on hv-cinder-maste Jan 05 15:00:10.701807 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-64e9cccb-b8a2-482c-9c96-2b9176d2a34b req-4cf5aca6-d1f6-44ed-99c7-239490bba533 service nova] Creating event network-vif-plugged:94077c14-de44-48f3-8ca4-3b1be238b708 for instance 67f4ef43-fb41-48ea-a380-e03f6fccf9c5 on hv-cinder-maste Jan 05 15:00:10.710021 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-64e9cccb-b8a2-482c-9c96-2b9176d2a34b req-4cf5aca6-d1f6-44ed-99c7-239490bba533 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.058592 Jan 05 15:00:10.714384 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 74/143] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:00:10.830923 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-cda39dd6-5d83-43ff-80d0-7751aa967ba9 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:10.838767 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-cda39dd6-5d83-43ff-80d0-7751aa967ba9 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1501 microversion: 2.1 time: 0.161650 Jan 05 15:00:10.839335 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 70/144] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:10 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:10.896437 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4ccfaa0b-4389-46cd-80fb-1697bfa32ff8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:10.897265 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4ccfaa0b-4389-46cd-80fb-1697bfa32ff8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:10.903253 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ccfaa0b-4389-46cd-80fb-1697bfa32ff8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:10.903794 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ccfaa0b-4389-46cd-80fb-1697bfa32ff8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:10.904655 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ccfaa0b-4389-46cd-80fb-1697bfa32ff8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:10.905185 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ccfaa0b-4389-46cd-80fb-1697bfa32ff8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:11.039591 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4ccfaa0b-4389-46cd-80fb-1697bfa32ff8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:11.047533 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4ccfaa0b-4389-46cd-80fb-1697bfa32ff8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.155084 Jan 05 15:00:11.048097 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 75/145] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:10 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:11.391515 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c9b4325a-e408-4dac-8809-9713f438f962 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:11.392119 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c9b4325a-e408-4dac-8809-9713f438f962 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:11.398669 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c9b4325a-e408-4dac-8809-9713f438f962 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:11.399192 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c9b4325a-e408-4dac-8809-9713f438f962 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:11.400127 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c9b4325a-e408-4dac-8809-9713f438f962 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:11.400657 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c9b4325a-e408-4dac-8809-9713f438f962 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:11.491615 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-79358c0e-db9c-473c-8fb9-d82fdfa2d894 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:11.494469 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-79358c0e-db9c-473c-8fb9-d82fdfa2d894 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:11.509911 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79358c0e-db9c-473c-8fb9-d82fdfa2d894 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:11.511481 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79358c0e-db9c-473c-8fb9-d82fdfa2d894 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:11.513647 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79358c0e-db9c-473c-8fb9-d82fdfa2d894 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:11.514378 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79358c0e-db9c-473c-8fb9-d82fdfa2d894 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:11.594968 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c9b4325a-e408-4dac-8809-9713f438f962 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:11.608804 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c9b4325a-e408-4dac-8809-9713f438f962 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:11.610803 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c9b4325a-e408-4dac-8809-9713f438f962 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:11.612108 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c9b4325a-e408-4dac-8809-9713f438f962 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1407 microversion: 2.20 time: 0.224828 Jan 05 15:00:11.613134 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 71/146] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:11 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:00:11.747726 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-79358c0e-db9c-473c-8fb9-d82fdfa2d894 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:11.760231 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-79358c0e-db9c-473c-8fb9-d82fdfa2d894 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.284041 Jan 05 15:00:11.761813 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 76/147] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:11 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:12.063612 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7e8d88a6-f247-4bbe-bf98-efc519e59041 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:12.064215 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7e8d88a6-f247-4bbe-bf98-efc519e59041 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:12.070506 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7e8d88a6-f247-4bbe-bf98-efc519e59041 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:12.070974 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7e8d88a6-f247-4bbe-bf98-efc519e59041 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:12.072012 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7e8d88a6-f247-4bbe-bf98-efc519e59041 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:12.078926 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7e8d88a6-f247-4bbe-bf98-efc519e59041 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:12.235601 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-7e8d88a6-f247-4bbe-bf98-efc519e59041 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:12.242868 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7e8d88a6-f247-4bbe-bf98-efc519e59041 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.183142 Jan 05 15:00:12.243430 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 72/148] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:12 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:12.629612 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-25eba272-c39e-4fbd-80d0-37f414437ed0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:12.630464 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-25eba272-c39e-4fbd-80d0-37f414437ed0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:12.636826 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25eba272-c39e-4fbd-80d0-37f414437ed0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:12.637466 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25eba272-c39e-4fbd-80d0-37f414437ed0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:12.638338 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25eba272-c39e-4fbd-80d0-37f414437ed0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:12.640028 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25eba272-c39e-4fbd-80d0-37f414437ed0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:12.725407 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-cc68709e-c32c-4337-844a-699f7833c5ae req-d4ccd0ba-7748-46d6-a705-582f83693212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "name": "network-vif-plugged", "status": "completed", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:12.727186 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:12.727186 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:00:12.746140 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-cc68709e-c32c-4337-844a-699f7833c5ae req-d4ccd0ba-7748-46d6-a705-582f83693212 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:12.746740 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-cc68709e-c32c-4337-844a-699f7833c5ae req-d4ccd0ba-7748-46d6-a705-582f83693212 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:12.758362 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-cc68709e-c32c-4337-844a-699f7833c5ae req-d4ccd0ba-7748-46d6-a705-582f83693212 service nova] Creating event network-vif-plugged:45483c3c-9f42-4aff-a962-22ff36647afc for instance 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 on hv-cinder-maste Jan 05 15:00:12.764154 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-cc68709e-c32c-4337-844a-699f7833c5ae req-d4ccd0ba-7748-46d6-a705-582f83693212 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042476 Jan 05 15:00:12.764776 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 73/149] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:00:12.771146 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b386086e-ae5b-4011-acfb-d1952c866105 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d72a2942-3fb5-4fea-8d42-01fdb3471f4a"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:12.772605 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b386086e-ae5b-4011-acfb-d1952c866105 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:12.778734 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b386086e-ae5b-4011-acfb-d1952c866105 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:12.779371 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b386086e-ae5b-4011-acfb-d1952c866105 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:12.780351 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b386086e-ae5b-4011-acfb-d1952c866105 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:12.781489 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b386086e-ae5b-4011-acfb-d1952c866105 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:12.795786 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-25eba272-c39e-4fbd-80d0-37f414437ed0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:12.804246 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-25eba272-c39e-4fbd-80d0-37f414437ed0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:12.805932 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-25eba272-c39e-4fbd-80d0-37f414437ed0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:12.807116 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-25eba272-c39e-4fbd-80d0-37f414437ed0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1407 microversion: 2.20 time: 0.181199 Jan 05 15:00:12.807761 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 77/150] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:12 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:00:12.822374 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-87163e7e-dae2-40be-82a4-ddb2fb3be6dd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:12.822374 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-87163e7e-dae2-40be-82a4-ddb2fb3be6dd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:12.826382 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87163e7e-dae2-40be-82a4-ddb2fb3be6dd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:12.826818 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87163e7e-dae2-40be-82a4-ddb2fb3be6dd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:12.827848 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87163e7e-dae2-40be-82a4-ddb2fb3be6dd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:12.828369 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87163e7e-dae2-40be-82a4-ddb2fb3be6dd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:12.967369 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-87163e7e-dae2-40be-82a4-ddb2fb3be6dd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:12.975075 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-87163e7e-dae2-40be-82a4-ddb2fb3be6dd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.160721 Jan 05 15:00:12.975686 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 78/151] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:12 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:13.260593 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2c83de59-de0d-4db7-afc1-8bc2767c2238 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:13.261380 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2c83de59-de0d-4db7-afc1-8bc2767c2238 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:13.269417 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c83de59-de0d-4db7-afc1-8bc2767c2238 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:13.269871 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c83de59-de0d-4db7-afc1-8bc2767c2238 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:13.271528 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c83de59-de0d-4db7-afc1-8bc2767c2238 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:13.271528 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c83de59-de0d-4db7-afc1-8bc2767c2238 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:13.481895 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-2c83de59-de0d-4db7-afc1-8bc2767c2238 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:13.489971 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2c83de59-de0d-4db7-afc1-8bc2767c2238 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.234367 Jan 05 15:00:13.490926 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 79/152] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:13 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:13.825434 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-849a4816-096e-4a07-bf66-fd3b7c660d00 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:13.826140 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-849a4816-096e-4a07-bf66-fd3b7c660d00 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:13.832390 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-849a4816-096e-4a07-bf66-fd3b7c660d00 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:13.832858 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-849a4816-096e-4a07-bf66-fd3b7c660d00 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:13.833689 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-849a4816-096e-4a07-bf66-fd3b7c660d00 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:13.834115 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-849a4816-096e-4a07-bf66-fd3b7c660d00 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:13.964580 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-849a4816-096e-4a07-bf66-fd3b7c660d00 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:13.972982 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-849a4816-096e-4a07-bf66-fd3b7c660d00 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:13.974544 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-849a4816-096e-4a07-bf66-fd3b7c660d00 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:13.975665 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-849a4816-096e-4a07-bf66-fd3b7c660d00 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1407 microversion: 2.20 time: 0.153994 Jan 05 15:00:13.976226 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 80/153] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:13 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:00:13.990891 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b7e40b19-2379-43af-b949-4b4d7d41353b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:13.991472 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b7e40b19-2379-43af-b949-4b4d7d41353b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:13.997014 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7e40b19-2379-43af-b949-4b4d7d41353b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:13.997484 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7e40b19-2379-43af-b949-4b4d7d41353b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:13.998408 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7e40b19-2379-43af-b949-4b4d7d41353b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:13.998832 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7e40b19-2379-43af-b949-4b4d7d41353b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:14.163128 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b7e40b19-2379-43af-b949-4b4d7d41353b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:14.167574 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b7e40b19-2379-43af-b949-4b4d7d41353b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.179730 Jan 05 15:00:14.168485 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 81/154] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:13 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:14.506318 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-17fdd0a1-1cb4-46c8-a249-aca0e0123b51 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:14.506921 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-17fdd0a1-1cb4-46c8-a249-aca0e0123b51 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:14.513192 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17fdd0a1-1cb4-46c8-a249-aca0e0123b51 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:14.513579 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17fdd0a1-1cb4-46c8-a249-aca0e0123b51 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:14.514360 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17fdd0a1-1cb4-46c8-a249-aca0e0123b51 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:14.515506 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17fdd0a1-1cb4-46c8-a249-aca0e0123b51 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:14.656687 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-17fdd0a1-1cb4-46c8-a249-aca0e0123b51 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:14.664016 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-17fdd0a1-1cb4-46c8-a249-aca0e0123b51 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.161458 Jan 05 15:00:14.664586 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 82/155] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:14 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:14.993700 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-55efc6d1-b89d-480b-aa87-22d82318c4bc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:14.994361 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-55efc6d1-b89d-480b-aa87-22d82318c4bc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:15.000622 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55efc6d1-b89d-480b-aa87-22d82318c4bc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:15.001083 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55efc6d1-b89d-480b-aa87-22d82318c4bc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:15.001851 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55efc6d1-b89d-480b-aa87-22d82318c4bc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:15.002287 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55efc6d1-b89d-480b-aa87-22d82318c4bc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:15.129659 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-55efc6d1-b89d-480b-aa87-22d82318c4bc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:15.137919 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-55efc6d1-b89d-480b-aa87-22d82318c4bc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:15.139398 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-55efc6d1-b89d-480b-aa87-22d82318c4bc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:15.140606 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-55efc6d1-b89d-480b-aa87-22d82318c4bc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1407 microversion: 2.20 time: 0.150655 Jan 05 15:00:15.141168 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 83/156] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:14 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:00:15.183861 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2fad29a6-8abf-43a8-b366-4f44677b310e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:15.184361 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2fad29a6-8abf-43a8-b366-4f44677b310e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:15.190742 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fad29a6-8abf-43a8-b366-4f44677b310e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:15.191201 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fad29a6-8abf-43a8-b366-4f44677b310e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:15.191963 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fad29a6-8abf-43a8-b366-4f44677b310e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:15.192387 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fad29a6-8abf-43a8-b366-4f44677b310e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:15.325054 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-2fad29a6-8abf-43a8-b366-4f44677b310e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:15.333092 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2fad29a6-8abf-43a8-b366-4f44677b310e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1362 microversion: 2.1 time: 0.152699 Jan 05 15:00:15.333669 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 84/157] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:15 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:15.680065 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-71d74b86-87e1-4941-b58f-32260ee3cf46 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:15.680914 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-71d74b86-87e1-4941-b58f-32260ee3cf46 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:15.687704 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71d74b86-87e1-4941-b58f-32260ee3cf46 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:15.688752 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71d74b86-87e1-4941-b58f-32260ee3cf46 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:15.689355 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71d74b86-87e1-4941-b58f-32260ee3cf46 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:15.689945 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71d74b86-87e1-4941-b58f-32260ee3cf46 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:15.820505 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-71d74b86-87e1-4941-b58f-32260ee3cf46 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:15.827810 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-71d74b86-87e1-4941-b58f-32260ee3cf46 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1322 microversion: 2.1 time: 0.151590 Jan 05 15:00:15.828395 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 85/158] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:15 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:16.159235 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ae02049d-d750-41d5-86cb-1bdebc269c53 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:16.160598 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ae02049d-d750-41d5-86cb-1bdebc269c53 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:16.166401 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae02049d-d750-41d5-86cb-1bdebc269c53 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:16.166840 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae02049d-d750-41d5-86cb-1bdebc269c53 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:16.167768 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae02049d-d750-41d5-86cb-1bdebc269c53 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:16.168323 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae02049d-d750-41d5-86cb-1bdebc269c53 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:16.313643 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-ae02049d-d750-41d5-86cb-1bdebc269c53 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:16.321386 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-ae02049d-d750-41d5-86cb-1bdebc269c53 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:16.322878 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-ae02049d-d750-41d5-86cb-1bdebc269c53 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:16.324015 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ae02049d-d750-41d5-86cb-1bdebc269c53 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1407 microversion: 2.20 time: 0.169456 Jan 05 15:00:16.329466 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 86/159] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:16 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:00:16.348626 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-75f1f3bf-4652-49e9-840c-8e8eb195477b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:16.349376 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-75f1f3bf-4652-49e9-840c-8e8eb195477b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:16.355557 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75f1f3bf-4652-49e9-840c-8e8eb195477b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:16.355998 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75f1f3bf-4652-49e9-840c-8e8eb195477b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:16.356769 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75f1f3bf-4652-49e9-840c-8e8eb195477b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:16.357224 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75f1f3bf-4652-49e9-840c-8e8eb195477b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:16.509403 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-75f1f3bf-4652-49e9-840c-8e8eb195477b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:16.509403 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-75f1f3bf-4652-49e9-840c-8e8eb195477b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1547 microversion: 2.1 time: 0.162950 Jan 05 15:00:16.509403 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 87/160] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:16 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:16.525328 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6d8415b1-2ff3-4685-b694-77d176e0e676 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:16.525814 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6d8415b1-2ff3-4685-b694-77d176e0e676 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:16.532158 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d8415b1-2ff3-4685-b694-77d176e0e676 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:16.532593 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d8415b1-2ff3-4685-b694-77d176e0e676 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:16.533479 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d8415b1-2ff3-4685-b694-77d176e0e676 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:16.533981 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d8415b1-2ff3-4685-b694-77d176e0e676 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:16.655052 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6d8415b1-2ff3-4685-b694-77d176e0e676 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133927 Jan 05 15:00:16.655707 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 88/161] 10.222.0.30 () {58 vars in 1274 bytes} [Wed Jan 5 15:00:16 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:00:16.695047 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b386086e-ae5b-4011-acfb-d1952c866105 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "POST /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.928463 Jan 05 15:00:16.700306 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 74/162] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Jan 5 15:00:12 2022] POST /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd/os-volume_attachments => generated 194 bytes in 3935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:00:16.846743 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6fec9cd4-a559-4d8d-81fd-5ee257141f3b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:16.847469 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6fec9cd4-a559-4d8d-81fd-5ee257141f3b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:16.853452 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fec9cd4-a559-4d8d-81fd-5ee257141f3b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:16.859127 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fec9cd4-a559-4d8d-81fd-5ee257141f3b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:16.859127 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fec9cd4-a559-4d8d-81fd-5ee257141f3b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:16.859127 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fec9cd4-a559-4d8d-81fd-5ee257141f3b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:17.190078 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6fec9cd4-a559-4d8d-81fd-5ee257141f3b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:17.201261 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6fec9cd4-a559-4d8d-81fd-5ee257141f3b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1517 microversion: 2.1 time: 0.357828 Jan 05 15:00:17.204857 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 89/163] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:16 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1517 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:17.221639 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-57c08678-a659-4899-87bf-077fc0073ee1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:17.222944 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-57c08678-a659-4899-87bf-077fc0073ee1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:17.230836 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-57c08678-a659-4899-87bf-077fc0073ee1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:17.232829 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-57c08678-a659-4899-87bf-077fc0073ee1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:17.232829 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-57c08678-a659-4899-87bf-077fc0073ee1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:17.233103 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-57c08678-a659-4899-87bf-077fc0073ee1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:17.263146 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-57c08678-a659-4899-87bf-077fc0073ee1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lazy-loading 'flavor' on Instance uuid 67f4ef43-fb41-48ea-a380-e03f6fccf9c5 {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:00:17.343020 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dd44ec1c-209b-44b2-bece-eaee84361148 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:17.343711 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dd44ec1c-209b-44b2-bece-eaee84361148 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:17.350917 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd44ec1c-209b-44b2-bece-eaee84361148 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:17.351759 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd44ec1c-209b-44b2-bece-eaee84361148 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:17.352600 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd44ec1c-209b-44b2-bece-eaee84361148 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:17.353381 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd44ec1c-209b-44b2-bece-eaee84361148 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:17.690992 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-57c08678-a659-4899-87bf-077fc0073ee1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "POST /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5/action" status: 200 len: 32 microversion: 2.1 time: 0.473948 Jan 05 15:00:17.691796 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 75/164] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:17 2022] POST /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5/action => generated 32 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:00:17.700673 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-9def92cc-22cc-4dae-aa99-b43f181c7d64 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:17.701398 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-9def92cc-22cc-4dae-aa99-b43f181c7d64 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:17.707898 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9def92cc-22cc-4dae-aa99-b43f181c7d64 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:17.708348 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9def92cc-22cc-4dae-aa99-b43f181c7d64 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:17.709164 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9def92cc-22cc-4dae-aa99-b43f181c7d64 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:17.709597 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9def92cc-22cc-4dae-aa99-b43f181c7d64 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:17.716930 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-dd44ec1c-209b-44b2-bece-eaee84361148 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:17.732410 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-dd44ec1c-209b-44b2-bece-eaee84361148 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:17.733967 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-dd44ec1c-209b-44b2-bece-eaee84361148 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:17.735072 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dd44ec1c-209b-44b2-bece-eaee84361148 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1407 microversion: 2.20 time: 0.396102 Jan 05 15:00:17.737151 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 90/165] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:17 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:00:17.852967 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-9def92cc-22cc-4dae-aa99-b43f181c7d64 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:17.860652 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-9def92cc-22cc-4dae-aa99-b43f181c7d64 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.163805 Jan 05 15:00:17.861254 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 76/166] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:17 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:18.338090 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9cebd0fc-748f-4138-b74f-a1daefb82d21 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:18.339492 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9cebd0fc-748f-4138-b74f-a1daefb82d21 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:18.341089 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-e7be2093-627e-4cfd-a2d8-33762caa2e47 req-0df93089-3ffd-4ccb-85b5-031ddd3d58c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3327c27f-a8e9-4b19-8041-fb5260278159", "tag": "2886de19-8aa3-470c-a593-9381bdb36ca0"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:18.342858 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:18.342858 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:00:18.345845 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cebd0fc-748f-4138-b74f-a1daefb82d21 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:18.346298 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cebd0fc-748f-4138-b74f-a1daefb82d21 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:18.347064 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cebd0fc-748f-4138-b74f-a1daefb82d21 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:18.347691 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cebd0fc-748f-4138-b74f-a1daefb82d21 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:18.350425 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-e7be2093-627e-4cfd-a2d8-33762caa2e47 req-0df93089-3ffd-4ccb-85b5-031ddd3d58c2 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:18.350867 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-e7be2093-627e-4cfd-a2d8-33762caa2e47 req-0df93089-3ffd-4ccb-85b5-031ddd3d58c2 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:18.362332 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-e7be2093-627e-4cfd-a2d8-33762caa2e47 req-0df93089-3ffd-4ccb-85b5-031ddd3d58c2 service nova] Creating event network-changed:2886de19-8aa3-470c-a593-9381bdb36ca0 for instance 3327c27f-a8e9-4b19-8041-fb5260278159 on hv-cinder-maste Jan 05 15:00:18.367594 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-e7be2093-627e-4cfd-a2d8-33762caa2e47 req-0df93089-3ffd-4ccb-85b5-031ddd3d58c2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031010 Jan 05 15:00:18.368265 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 77/167] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:00:18.754807 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c716058c-3f34-4e94-a854-fcd2e086e297 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:18.755499 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c716058c-3f34-4e94-a854-fcd2e086e297 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:18.761552 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c716058c-3f34-4e94-a854-fcd2e086e297 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:18.761997 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c716058c-3f34-4e94-a854-fcd2e086e297 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:18.762778 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c716058c-3f34-4e94-a854-fcd2e086e297 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:18.763208 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c716058c-3f34-4e94-a854-fcd2e086e297 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:18.900175 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c716058c-3f34-4e94-a854-fcd2e086e297 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:18.908642 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c716058c-3f34-4e94-a854-fcd2e086e297 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:18.910214 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c716058c-3f34-4e94-a854-fcd2e086e297 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:18.911309 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c716058c-3f34-4e94-a854-fcd2e086e297 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1407 microversion: 2.20 time: 0.160543 Jan 05 15:00:18.911867 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 78/168] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:18 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:00:18.917400 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3875ac16-889e-4699-a693-d81fa7001b55 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:18.918160 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3875ac16-889e-4699-a693-d81fa7001b55 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:18.935356 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3875ac16-889e-4699-a693-d81fa7001b55 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:18.935963 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3875ac16-889e-4699-a693-d81fa7001b55 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:18.936835 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3875ac16-889e-4699-a693-d81fa7001b55 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:18.937295 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3875ac16-889e-4699-a693-d81fa7001b55 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:19.079074 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3875ac16-889e-4699-a693-d81fa7001b55 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:19.080282 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3875ac16-889e-4699-a693-d81fa7001b55 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.167223 Jan 05 15:00:19.080852 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 79/169] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:18 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:19.931538 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1597c5f5-1e73-4449-8e4d-5d940888e0c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:19.932202 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1597c5f5-1e73-4449-8e4d-5d940888e0c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:19.939075 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1597c5f5-1e73-4449-8e4d-5d940888e0c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:19.939513 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1597c5f5-1e73-4449-8e4d-5d940888e0c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:19.940279 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1597c5f5-1e73-4449-8e4d-5d940888e0c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:19.940709 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1597c5f5-1e73-4449-8e4d-5d940888e0c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:20.068839 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-1597c5f5-1e73-4449-8e4d-5d940888e0c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:20.076753 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-1597c5f5-1e73-4449-8e4d-5d940888e0c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:20.078326 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-1597c5f5-1e73-4449-8e4d-5d940888e0c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:20.079401 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1597c5f5-1e73-4449-8e4d-5d940888e0c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1407 microversion: 2.20 time: 0.151579 Jan 05 15:00:20.079954 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 80/170] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:19 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:00:20.096914 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c9db5794-b09b-4500-ac6b-67736df8f567 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:20.101677 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c9db5794-b09b-4500-ac6b-67736df8f567 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:20.103072 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c9db5794-b09b-4500-ac6b-67736df8f567 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:20.103518 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c9db5794-b09b-4500-ac6b-67736df8f567 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:20.104291 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c9db5794-b09b-4500-ac6b-67736df8f567 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:20.104978 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c9db5794-b09b-4500-ac6b-67736df8f567 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:20.364639 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c9db5794-b09b-4500-ac6b-67736df8f567 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:20.371903 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c9db5794-b09b-4500-ac6b-67736df8f567 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.278976 Jan 05 15:00:20.372497 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 81/171] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:20 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:20.964985 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9cebd0fc-748f-4138-b74f-a1daefb82d21 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 14 microversion: 2.1 time: 2.630545 Jan 05 15:00:20.966378 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 91/172] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:18 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 14 bytes in 2632 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:00:21.098496 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-75380eca-be54-4628-955a-5451b92df35a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:21.099710 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-75380eca-be54-4628-955a-5451b92df35a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:21.106304 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-75380eca-be54-4628-955a-5451b92df35a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:21.106790 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-75380eca-be54-4628-955a-5451b92df35a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:21.108319 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-75380eca-be54-4628-955a-5451b92df35a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:21.109453 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-75380eca-be54-4628-955a-5451b92df35a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:21.304217 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-75380eca-be54-4628-955a-5451b92df35a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:21.312022 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-75380eca-be54-4628-955a-5451b92df35a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:21.313646 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-75380eca-be54-4628-955a-5451b92df35a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:21.314747 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-75380eca-be54-4628-955a-5451b92df35a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1407 microversion: 2.20 time: 0.220262 Jan 05 15:00:21.315887 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 82/173] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:21 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:00:21.388344 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-599fbca8-df57-4e22-b980-8e6c5cc2e1bb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:21.389335 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-599fbca8-df57-4e22-b980-8e6c5cc2e1bb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:21.397892 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-599fbca8-df57-4e22-b980-8e6c5cc2e1bb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:21.398328 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-599fbca8-df57-4e22-b980-8e6c5cc2e1bb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:21.399122 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-599fbca8-df57-4e22-b980-8e6c5cc2e1bb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:21.399902 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-599fbca8-df57-4e22-b980-8e6c5cc2e1bb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:21.604034 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-599fbca8-df57-4e22-b980-8e6c5cc2e1bb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:21.612490 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-599fbca8-df57-4e22-b980-8e6c5cc2e1bb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.228332 Jan 05 15:00:21.613194 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 92/174] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:21 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:21.976185 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-09891316-0343-4440-8bff-ff83ef8d0350 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:21.989826 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-09891316-0343-4440-8bff-ff83ef8d0350 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:21.989826 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-09891316-0343-4440-8bff-ff83ef8d0350 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:21.989826 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-09891316-0343-4440-8bff-ff83ef8d0350 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:21.989826 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-09891316-0343-4440-8bff-ff83ef8d0350 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:21.990190 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-09891316-0343-4440-8bff-ff83ef8d0350 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:22.069336 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-09891316-0343-4440-8bff-ff83ef8d0350 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 14 microversion: 2.1 time: 0.096787 Jan 05 15:00:22.069981 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 83/175] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:21 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 05 15:00:22.332712 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-661dc4eb-efce-4941-aeae-67b089d5b78d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:22.333347 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-661dc4eb-efce-4941-aeae-67b089d5b78d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:22.339731 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-661dc4eb-efce-4941-aeae-67b089d5b78d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:22.340180 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-661dc4eb-efce-4941-aeae-67b089d5b78d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:22.340957 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-661dc4eb-efce-4941-aeae-67b089d5b78d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:22.341414 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-661dc4eb-efce-4941-aeae-67b089d5b78d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:22.482654 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-661dc4eb-efce-4941-aeae-67b089d5b78d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:22.490960 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-661dc4eb-efce-4941-aeae-67b089d5b78d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:22.492466 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-661dc4eb-efce-4941-aeae-67b089d5b78d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:22.493649 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-661dc4eb-efce-4941-aeae-67b089d5b78d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1600 microversion: 2.20 time: 0.164751 Jan 05 15:00:22.494614 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 93/176] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:00:22 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:00:22.513083 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6d7ca165-f5c5-45de-bcee-1995e299d25b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:22.513770 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-6d7ca165-f5c5-45de-bcee-1995e299d25b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:22.521257 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6d7ca165-f5c5-45de-bcee-1995e299d25b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:22.523178 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6d7ca165-f5c5-45de-bcee-1995e299d25b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:22.523178 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6d7ca165-f5c5-45de-bcee-1995e299d25b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:22.523178 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6d7ca165-f5c5-45de-bcee-1995e299d25b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:22.632881 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cffced0a-0155-4f3c-94a9-462b07a49425 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:22.641932 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cffced0a-0155-4f3c-94a9-462b07a49425 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:22.645972 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cffced0a-0155-4f3c-94a9-462b07a49425 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:22.646425 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cffced0a-0155-4f3c-94a9-462b07a49425 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:22.647230 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cffced0a-0155-4f3c-94a9-462b07a49425 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:22.647642 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cffced0a-0155-4f3c-94a9-462b07a49425 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:22.790611 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-cffced0a-0155-4f3c-94a9-462b07a49425 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:22.793528 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6d7ca165-f5c5-45de-bcee-1995e299d25b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.284675 Jan 05 15:00:22.794793 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 84/177] 10.222.0.30 () {60 vars in 1315 bytes} [Wed Jan 5 15:00:22 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-interface => generated 285 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:00:22.803642 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cffced0a-0155-4f3c-94a9-462b07a49425 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.177403 Jan 05 15:00:22.804823 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 94/178] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:22 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:23.080486 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-9843f5a2-1d94-4afb-8e4e-6592949eba9a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:23.081910 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-9843f5a2-1d94-4afb-8e4e-6592949eba9a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:23.088948 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9843f5a2-1d94-4afb-8e4e-6592949eba9a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:23.090996 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9843f5a2-1d94-4afb-8e4e-6592949eba9a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:23.090996 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9843f5a2-1d94-4afb-8e4e-6592949eba9a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:23.090996 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9843f5a2-1d94-4afb-8e4e-6592949eba9a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:23.821649 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-931f1672-4c53-46ea-b6e7-47de87a69c5a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:23.822798 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-931f1672-4c53-46ea-b6e7-47de87a69c5a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:23.837528 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-931f1672-4c53-46ea-b6e7-47de87a69c5a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:23.837982 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-931f1672-4c53-46ea-b6e7-47de87a69c5a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:23.838810 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-931f1672-4c53-46ea-b6e7-47de87a69c5a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:23.839237 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-931f1672-4c53-46ea-b6e7-47de87a69c5a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:24.071208 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-931f1672-4c53-46ea-b6e7-47de87a69c5a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:24.079140 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-931f1672-4c53-46ea-b6e7-47de87a69c5a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.261247 Jan 05 15:00:24.079725 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 95/179] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:23 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:24.125472 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f0b504e8-aa92-49e0-899a-b88b20db19da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:24.126464 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f0b504e8-aa92-49e0-899a-b88b20db19da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:24.132670 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0b504e8-aa92-49e0-899a-b88b20db19da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:24.133102 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0b504e8-aa92-49e0-899a-b88b20db19da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:24.134153 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0b504e8-aa92-49e0-899a-b88b20db19da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:24.134688 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0b504e8-aa92-49e0-899a-b88b20db19da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:25.688952 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-9843f5a2-1d94-4afb-8e4e-6592949eba9a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 14 microversion: 2.1 time: 2.612610 Jan 05 15:00:25.692368 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 85/180] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:23 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 14 bytes in 2614 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 05 15:00:25.694677 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-b1a0af80-80c2-45a7-9df4-d801b7ee88a6 req-9105904c-d5dd-44e3-9379-ebffcdafabef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:25.696163 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:25.696163 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:00:25.704246 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-b1a0af80-80c2-45a7-9df4-d801b7ee88a6 req-9105904c-d5dd-44e3-9379-ebffcdafabef service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:25.704680 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-b1a0af80-80c2-45a7-9df4-d801b7ee88a6 req-9105904c-d5dd-44e3-9379-ebffcdafabef service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:25.715125 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-b1a0af80-80c2-45a7-9df4-d801b7ee88a6 req-9105904c-d5dd-44e3-9379-ebffcdafabef service nova] Creating event network-changed:45483c3c-9f42-4aff-a962-22ff36647afc for instance 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 on hv-cinder-maste Jan 05 15:00:25.720416 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-b1a0af80-80c2-45a7-9df4-d801b7ee88a6 req-9105904c-d5dd-44e3-9379-ebffcdafabef service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029499 Jan 05 15:00:25.721522 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 86/181] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:00:25.722239 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f0b504e8-aa92-49e0-899a-b88b20db19da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 14 microversion: 2.20 time: 1.601697 Jan 05 15:00:25.725890 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 96/182] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:24 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 14 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:25.730138 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-083eb67c-c4bc-42f4-b4a8-7142d71bda83 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:25.730138 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-083eb67c-c4bc-42f4-b4a8-7142d71bda83 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:25.734819 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-083eb67c-c4bc-42f4-b4a8-7142d71bda83 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:25.735270 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-083eb67c-c4bc-42f4-b4a8-7142d71bda83 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:25.736075 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-083eb67c-c4bc-42f4-b4a8-7142d71bda83 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:25.736498 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-083eb67c-c4bc-42f4-b4a8-7142d71bda83 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:25.893177 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-083eb67c-c4bc-42f4-b4a8-7142d71bda83 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:25.893177 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-083eb67c-c4bc-42f4-b4a8-7142d71bda83 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.160091 Jan 05 15:00:25.893177 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 87/183] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:25 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:26.700340 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-170e12dc-88e9-4716-8f92-826f26550821 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:26.701387 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-170e12dc-88e9-4716-8f92-826f26550821 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:26.708767 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-170e12dc-88e9-4716-8f92-826f26550821 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:26.709247 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-170e12dc-88e9-4716-8f92-826f26550821 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:26.710088 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-170e12dc-88e9-4716-8f92-826f26550821 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:26.717031 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-170e12dc-88e9-4716-8f92-826f26550821 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:26.732938 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-63c6187e-0474-48eb-992d-70d91575542b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:26.733876 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-63c6187e-0474-48eb-992d-70d91575542b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:26.740109 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-63c6187e-0474-48eb-992d-70d91575542b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:26.740556 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-63c6187e-0474-48eb-992d-70d91575542b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:26.741364 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-63c6187e-0474-48eb-992d-70d91575542b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:26.741963 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-63c6187e-0474-48eb-992d-70d91575542b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:26.879899 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-170e12dc-88e9-4716-8f92-826f26550821 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 14 microversion: 2.1 time: 0.183511 Jan 05 15:00:26.883175 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 97/184] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:26 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:00:26.905241 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-63c6187e-0474-48eb-992d-70d91575542b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 14 microversion: 2.20 time: 0.175990 Jan 05 15:00:26.906017 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 88/185] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:26 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:26.910850 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9d231789-3f93-480a-9b1f-6c8ff870dea5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:26.911420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9d231789-3f93-480a-9b1f-6c8ff870dea5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:26.921775 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d231789-3f93-480a-9b1f-6c8ff870dea5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:26.921775 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d231789-3f93-480a-9b1f-6c8ff870dea5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:26.921775 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d231789-3f93-480a-9b1f-6c8ff870dea5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:26.921775 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d231789-3f93-480a-9b1f-6c8ff870dea5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:27.053597 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-9d231789-3f93-480a-9b1f-6c8ff870dea5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:27.063413 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9d231789-3f93-480a-9b1f-6c8ff870dea5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.159312 Jan 05 15:00:27.064045 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 98/186] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:26 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:27.895036 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-96082976-9727-4cea-94fc-5418324254ec tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:27.896315 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-96082976-9727-4cea-94fc-5418324254ec tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:27.903577 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96082976-9727-4cea-94fc-5418324254ec tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:27.904015 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96082976-9727-4cea-94fc-5418324254ec tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:27.910294 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96082976-9727-4cea-94fc-5418324254ec tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:27.910294 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96082976-9727-4cea-94fc-5418324254ec tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:27.915975 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-51a4b681-8ae8-4992-b2d7-30818664843d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:27.916965 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-51a4b681-8ae8-4992-b2d7-30818664843d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:27.928170 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51a4b681-8ae8-4992-b2d7-30818664843d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:27.932930 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51a4b681-8ae8-4992-b2d7-30818664843d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:27.932930 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51a4b681-8ae8-4992-b2d7-30818664843d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:27.932930 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51a4b681-8ae8-4992-b2d7-30818664843d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:28.069749 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-96082976-9727-4cea-94fc-5418324254ec tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 14 microversion: 2.1 time: 0.180707 Jan 05 15:00:28.070380 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 89/187] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:27 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:00:28.081103 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-869ab80d-5d2b-43b2-abf0-80d193fd8490 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:28.088319 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-869ab80d-5d2b-43b2-abf0-80d193fd8490 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:28.088835 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-869ab80d-5d2b-43b2-abf0-80d193fd8490 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:28.089317 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-869ab80d-5d2b-43b2-abf0-80d193fd8490 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:28.090101 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-869ab80d-5d2b-43b2-abf0-80d193fd8490 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:28.090534 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-869ab80d-5d2b-43b2-abf0-80d193fd8490 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:28.114899 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-51a4b681-8ae8-4992-b2d7-30818664843d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 14 microversion: 2.20 time: 0.202494 Jan 05 15:00:28.118674 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 99/188] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:27 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 14 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:28.240542 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-869ab80d-5d2b-43b2-abf0-80d193fd8490 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:28.247956 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-869ab80d-5d2b-43b2-abf0-80d193fd8490 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.171137 Jan 05 15:00:28.248531 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 90/189] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:28 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:29.081676 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-38f7a1f0-34ee-49f8-a1da-3102c96481d9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:29.082648 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-38f7a1f0-34ee-49f8-a1da-3102c96481d9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:29.090169 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f7a1f0-34ee-49f8-a1da-3102c96481d9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:29.090621 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f7a1f0-34ee-49f8-a1da-3102c96481d9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:29.091414 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f7a1f0-34ee-49f8-a1da-3102c96481d9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:29.091832 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f7a1f0-34ee-49f8-a1da-3102c96481d9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:29.130601 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-29e2239f-a1ee-4858-9ddd-73a501d09808 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:29.130601 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-29e2239f-a1ee-4858-9ddd-73a501d09808 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:29.135920 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-29e2239f-a1ee-4858-9ddd-73a501d09808 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:29.136977 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-29e2239f-a1ee-4858-9ddd-73a501d09808 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:29.138024 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-29e2239f-a1ee-4858-9ddd-73a501d09808 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:29.139061 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-29e2239f-a1ee-4858-9ddd-73a501d09808 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:31.809272 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-29e2239f-a1ee-4858-9ddd-73a501d09808 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 14 microversion: 2.20 time: 2.686964 Jan 05 15:00:31.812811 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 91/190] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:29 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 14 bytes in 2691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:31.818314 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-804e733f-8bc3-47b2-b679-063bd90ed0cc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:31.819015 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-804e733f-8bc3-47b2-b679-063bd90ed0cc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:31.825909 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-804e733f-8bc3-47b2-b679-063bd90ed0cc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:31.826624 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-804e733f-8bc3-47b2-b679-063bd90ed0cc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:31.827882 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-804e733f-8bc3-47b2-b679-063bd90ed0cc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:31.828474 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-804e733f-8bc3-47b2-b679-063bd90ed0cc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:31.856330 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-38f7a1f0-34ee-49f8-a1da-3102c96481d9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 14 microversion: 2.1 time: 2.778827 Jan 05 15:00:31.857772 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 100/191] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:29 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 14 bytes in 2781 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:00:31.990641 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-804e733f-8bc3-47b2-b679-063bd90ed0cc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:32.003702 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-804e733f-8bc3-47b2-b679-063bd90ed0cc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.186143 Jan 05 15:00:32.004411 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 92/192] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:31 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:32.820547 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b530691a-27f2-4b23-9f1f-71e8150ebb1d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:32.821605 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b530691a-27f2-4b23-9f1f-71e8150ebb1d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:32.828950 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b530691a-27f2-4b23-9f1f-71e8150ebb1d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:32.829429 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b530691a-27f2-4b23-9f1f-71e8150ebb1d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:32.830332 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b530691a-27f2-4b23-9f1f-71e8150ebb1d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:32.830772 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b530691a-27f2-4b23-9f1f-71e8150ebb1d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:32.873766 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7af383d3-3ebb-4a91-b4f6-3061e3e2ba47 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:32.874468 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7af383d3-3ebb-4a91-b4f6-3061e3e2ba47 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:32.880627 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7af383d3-3ebb-4a91-b4f6-3061e3e2ba47 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:32.881156 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7af383d3-3ebb-4a91-b4f6-3061e3e2ba47 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:32.881947 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7af383d3-3ebb-4a91-b4f6-3061e3e2ba47 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:32.882372 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7af383d3-3ebb-4a91-b4f6-3061e3e2ba47 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:35.134953 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7af383d3-3ebb-4a91-b4f6-3061e3e2ba47 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 6451 microversion: 2.1 time: 2.264749 Jan 05 15:00:35.136327 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 93/193] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:32 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 6451 bytes in 2266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:35.141039 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-9544c204-937d-4b8d-8719-696fdcba22b5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:35.141746 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-9544c204-937d-4b8d-8719-696fdcba22b5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:35.148561 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9544c204-937d-4b8d-8719-696fdcba22b5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:35.149002 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9544c204-937d-4b8d-8719-696fdcba22b5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:35.149789 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9544c204-937d-4b8d-8719-696fdcba22b5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:35.150214 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9544c204-937d-4b8d-8719-696fdcba22b5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:35.166227 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b530691a-27f2-4b23-9f1f-71e8150ebb1d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 14 microversion: 2.20 time: 2.349534 Jan 05 15:00:35.166864 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 101/194] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:32 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 14 bytes in 2351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:35.284200 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-9544c204-937d-4b8d-8719-696fdcba22b5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:35.291413 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-9544c204-937d-4b8d-8719-696fdcba22b5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.154719 Jan 05 15:00:35.291980 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 94/195] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:35 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:36.158000 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-666895e6-95eb-466e-8f53-de30f41ae78a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:36.158000 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-666895e6-95eb-466e-8f53-de30f41ae78a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:36.158000 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-666895e6-95eb-466e-8f53-de30f41ae78a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:36.158000 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-666895e6-95eb-466e-8f53-de30f41ae78a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:36.158638 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-666895e6-95eb-466e-8f53-de30f41ae78a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:36.159063 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-666895e6-95eb-466e-8f53-de30f41ae78a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:36.177399 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e0b22c14-080b-41f4-a57f-8a873e96f44b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:36.179000 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e0b22c14-080b-41f4-a57f-8a873e96f44b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:36.192087 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e0b22c14-080b-41f4-a57f-8a873e96f44b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:36.192374 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e0b22c14-080b-41f4-a57f-8a873e96f44b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:36.193234 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e0b22c14-080b-41f4-a57f-8a873e96f44b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:36.193714 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e0b22c14-080b-41f4-a57f-8a873e96f44b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:36.319513 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-666895e6-95eb-466e-8f53-de30f41ae78a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 10009 microversion: 2.1 time: 0.176136 Jan 05 15:00:36.320180 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 102/196] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:36 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 10009 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:00:36.324904 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1547eab2-7723-4eaf-b320-215b71dba76d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:36.325611 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1547eab2-7723-4eaf-b320-215b71dba76d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:36.332516 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1547eab2-7723-4eaf-b320-215b71dba76d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:36.332957 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1547eab2-7723-4eaf-b320-215b71dba76d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:36.334014 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1547eab2-7723-4eaf-b320-215b71dba76d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:36.339877 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1547eab2-7723-4eaf-b320-215b71dba76d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:36.353183 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e0b22c14-080b-41f4-a57f-8a873e96f44b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 14 microversion: 2.20 time: 0.179230 Jan 05 15:00:36.353836 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 95/197] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:36 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:36.485249 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1547eab2-7723-4eaf-b320-215b71dba76d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:36.495001 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1547eab2-7723-4eaf-b320-215b71dba76d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.173704 Jan 05 15:00:36.495761 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 103/198] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:36 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:37.331347 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-fe6f8c31-010a-488b-a7a5-c505f504f224 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:37.332346 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-fe6f8c31-010a-488b-a7a5-c505f504f224 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:37.339132 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fe6f8c31-010a-488b-a7a5-c505f504f224 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:37.339579 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fe6f8c31-010a-488b-a7a5-c505f504f224 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:37.340364 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fe6f8c31-010a-488b-a7a5-c505f504f224 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:37.340792 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fe6f8c31-010a-488b-a7a5-c505f504f224 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:37.364450 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d940a677-698a-4556-9b6d-06ab6171c1b0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:37.365520 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d940a677-698a-4556-9b6d-06ab6171c1b0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:37.371945 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d940a677-698a-4556-9b6d-06ab6171c1b0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:37.376051 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d940a677-698a-4556-9b6d-06ab6171c1b0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:37.376947 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d940a677-698a-4556-9b6d-06ab6171c1b0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:37.378848 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d940a677-698a-4556-9b6d-06ab6171c1b0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:37.507863 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-fe6f8c31-010a-488b-a7a5-c505f504f224 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 15064 microversion: 2.1 time: 0.180429 Jan 05 15:00:37.511393 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 96/199] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:37 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 15064 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:00:37.523008 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7088d042-d2d8-45a9-b463-955dbff684eb tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:37.523008 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7088d042-d2d8-45a9-b463-955dbff684eb tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:37.528091 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7088d042-d2d8-45a9-b463-955dbff684eb tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:37.528500 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7088d042-d2d8-45a9-b463-955dbff684eb tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:37.529329 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7088d042-d2d8-45a9-b463-955dbff684eb tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:37.529762 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7088d042-d2d8-45a9-b463-955dbff684eb tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:37.548482 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d940a677-698a-4556-9b6d-06ab6171c1b0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 14 microversion: 2.20 time: 0.187701 Jan 05 15:00:37.564073 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 104/200] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:37 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 14 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:37.565732 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7088d042-d2d8-45a9-b463-955dbff684eb tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Going to try to terminate instance {{(pid=128789) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:00:37.565863 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e152cd3e-d50b-4027-ac1a-e24138da5de7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:37.565863 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e152cd3e-d50b-4027-ac1a-e24138da5de7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:37.570458 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e152cd3e-d50b-4027-ac1a-e24138da5de7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:37.571155 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e152cd3e-d50b-4027-ac1a-e24138da5de7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:37.572021 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e152cd3e-d50b-4027-ac1a-e24138da5de7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:37.572908 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e152cd3e-d50b-4027-ac1a-e24138da5de7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:37.856306 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e152cd3e-d50b-4027-ac1a-e24138da5de7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:37.856881 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e152cd3e-d50b-4027-ac1a-e24138da5de7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.303593 Jan 05 15:00:37.857483 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 105/201] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:37 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:38.226715 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7088d042-d2d8-45a9-b463-955dbff684eb tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 204 len: 0 microversion: 2.1 time: 0.716283 Jan 05 15:00:38.227355 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 97/202] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:00:37 2022] DELETE /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 0 bytes in 718 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:00:38.236065 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-33247a44-431e-4796-bf34-b60d7253c9b7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:38.236680 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-33247a44-431e-4796-bf34-b60d7253c9b7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:38.243109 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33247a44-431e-4796-bf34-b60d7253c9b7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:38.243555 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33247a44-431e-4796-bf34-b60d7253c9b7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:38.244331 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33247a44-431e-4796-bf34-b60d7253c9b7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:38.244780 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33247a44-431e-4796-bf34-b60d7253c9b7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:38.510042 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-33247a44-431e-4796-bf34-b60d7253c9b7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:38.518387 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-33247a44-431e-4796-bf34-b60d7253c9b7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1553 microversion: 2.1 time: 0.286733 Jan 05 15:00:38.518943 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 106/203] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:38 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1553 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:38.519948 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-cf0e933e-9b9b-4c9f-aa2f-ea74b72aa516 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:38.520942 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-cf0e933e-9b9b-4c9f-aa2f-ea74b72aa516 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:38.526672 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cf0e933e-9b9b-4c9f-aa2f-ea74b72aa516 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:38.527106 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cf0e933e-9b9b-4c9f-aa2f-ea74b72aa516 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:38.527877 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cf0e933e-9b9b-4c9f-aa2f-ea74b72aa516 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:38.528305 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cf0e933e-9b9b-4c9f-aa2f-ea74b72aa516 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:38.571227 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d93b62af-34f9-4d09-8343-c816e99731e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:38.572175 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d93b62af-34f9-4d09-8343-c816e99731e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:38.578425 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d93b62af-34f9-4d09-8343-c816e99731e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:38.579567 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d93b62af-34f9-4d09-8343-c816e99731e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:38.579671 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d93b62af-34f9-4d09-8343-c816e99731e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:38.580003 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d93b62af-34f9-4d09-8343-c816e99731e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:41.159572 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d93b62af-34f9-4d09-8343-c816e99731e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 12613 microversion: 2.20 time: 2.591451 Jan 05 15:00:41.160253 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 107/204] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:38 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 12613 bytes in 2593 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:00:41.165207 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8d918d6e-e369-4693-bcfd-ce77b57a3884 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:41.165906 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8d918d6e-e369-4693-bcfd-ce77b57a3884 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:41.172676 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d918d6e-e369-4693-bcfd-ce77b57a3884 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:41.173138 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d918d6e-e369-4693-bcfd-ce77b57a3884 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:41.173917 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d918d6e-e369-4693-bcfd-ce77b57a3884 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:41.174343 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d918d6e-e369-4693-bcfd-ce77b57a3884 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:41.210080 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-cf0e933e-9b9b-4c9f-aa2f-ea74b72aa516 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 19014 microversion: 2.1 time: 2.694029 Jan 05 15:00:41.214368 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 98/205] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:38 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 19014 bytes in 2696 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:00:41.215501 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d5e807f2-46cf-41bb-af4b-3d1f56392e97 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:41.216375 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d5e807f2-46cf-41bb-af4b-3d1f56392e97 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:41.223816 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d5e807f2-46cf-41bb-af4b-3d1f56392e97 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:41.224258 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d5e807f2-46cf-41bb-af4b-3d1f56392e97 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:41.225102 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d5e807f2-46cf-41bb-af4b-3d1f56392e97 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:41.225502 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d5e807f2-46cf-41bb-af4b-3d1f56392e97 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:41.315151 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8d918d6e-e369-4693-bcfd-ce77b57a3884 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:41.323480 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8d918d6e-e369-4693-bcfd-ce77b57a3884 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.162124 Jan 05 15:00:41.324065 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 108/206] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:41 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:41.369829 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d5e807f2-46cf-41bb-af4b-3d1f56392e97 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:41.377653 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d5e807f2-46cf-41bb-af4b-3d1f56392e97 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1553 microversion: 2.1 time: 0.165849 Jan 05 15:00:41.378212 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 99/207] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:41 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:42.171181 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2edc42fb-1c1c-4d84-b0e2-00ad60a0b215 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:42.172118 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2edc42fb-1c1c-4d84-b0e2-00ad60a0b215 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:42.180822 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2edc42fb-1c1c-4d84-b0e2-00ad60a0b215 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:42.181296 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2edc42fb-1c1c-4d84-b0e2-00ad60a0b215 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:42.183839 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2edc42fb-1c1c-4d84-b0e2-00ad60a0b215 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:42.184350 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2edc42fb-1c1c-4d84-b0e2-00ad60a0b215 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:42.224277 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2732e3e0-87b6-415d-beca-bed92f5fe5f7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:42.225286 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2732e3e0-87b6-415d-beca-bed92f5fe5f7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:42.231792 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2732e3e0-87b6-415d-beca-bed92f5fe5f7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:42.232242 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2732e3e0-87b6-415d-beca-bed92f5fe5f7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:42.236265 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2732e3e0-87b6-415d-beca-bed92f5fe5f7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:42.236265 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2732e3e0-87b6-415d-beca-bed92f5fe5f7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:42.351411 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2edc42fb-1c1c-4d84-b0e2-00ad60a0b215 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 15064 microversion: 2.20 time: 0.183814 Jan 05 15:00:42.352077 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 109/208] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:42 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 15064 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:00:42.357272 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2eae197e-cba6-4fd1-9b5e-933a7b57847a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:42.358103 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2eae197e-cba6-4fd1-9b5e-933a7b57847a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:42.364806 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eae197e-cba6-4fd1-9b5e-933a7b57847a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:42.365294 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eae197e-cba6-4fd1-9b5e-933a7b57847a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:42.366087 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eae197e-cba6-4fd1-9b5e-933a7b57847a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:42.366771 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eae197e-cba6-4fd1-9b5e-933a7b57847a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:42.398712 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2732e3e0-87b6-415d-beca-bed92f5fe5f7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 19342 microversion: 2.1 time: 0.177946 Jan 05 15:00:42.399711 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 100/209] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:42 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 19342 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:00:42.406226 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3c48f94c-6ec8-405f-882e-c235db9650ad tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:42.411645 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3c48f94c-6ec8-405f-882e-c235db9650ad tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:42.414208 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3c48f94c-6ec8-405f-882e-c235db9650ad tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:42.415014 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3c48f94c-6ec8-405f-882e-c235db9650ad tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:42.416718 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3c48f94c-6ec8-405f-882e-c235db9650ad tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:42.417623 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3c48f94c-6ec8-405f-882e-c235db9650ad tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:42.550502 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-2eae197e-cba6-4fd1-9b5e-933a7b57847a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:42.558786 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2eae197e-cba6-4fd1-9b5e-933a7b57847a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.205427 Jan 05 15:00:42.560773 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 110/210] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:42 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:42.584627 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3c48f94c-6ec8-405f-882e-c235db9650ad tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:42.592632 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3c48f94c-6ec8-405f-882e-c235db9650ad tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1553 microversion: 2.1 time: 0.191379 Jan 05 15:00:42.593385 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 101/211] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:42 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:43.363420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2da67b06-bca0-4d82-a8c6-e8a36910c6d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:43.364928 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2da67b06-bca0-4d82-a8c6-e8a36910c6d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:43.372951 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2da67b06-bca0-4d82-a8c6-e8a36910c6d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:43.373437 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2da67b06-bca0-4d82-a8c6-e8a36910c6d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:43.374257 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2da67b06-bca0-4d82-a8c6-e8a36910c6d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:43.375043 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2da67b06-bca0-4d82-a8c6-e8a36910c6d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:43.410041 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-903bf7f0-07a0-4a84-8fe0-b9f536760877 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:43.411016 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-903bf7f0-07a0-4a84-8fe0-b9f536760877 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:43.417230 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-903bf7f0-07a0-4a84-8fe0-b9f536760877 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:43.417677 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-903bf7f0-07a0-4a84-8fe0-b9f536760877 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:43.418537 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-903bf7f0-07a0-4a84-8fe0-b9f536760877 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:43.418983 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-903bf7f0-07a0-4a84-8fe0-b9f536760877 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:43.548194 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2da67b06-bca0-4d82-a8c6-e8a36910c6d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 17602 microversion: 2.20 time: 0.189038 Jan 05 15:00:43.551820 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 111/212] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:43 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 17602 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:00:43.576981 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-170bddd6-05b2-40c0-a06b-ca8a1e72c66a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:43.577843 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-170bddd6-05b2-40c0-a06b-ca8a1e72c66a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:43.586739 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-170bddd6-05b2-40c0-a06b-ca8a1e72c66a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:43.586739 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-170bddd6-05b2-40c0-a06b-ca8a1e72c66a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:43.587229 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-170bddd6-05b2-40c0-a06b-ca8a1e72c66a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:43.587512 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-170bddd6-05b2-40c0-a06b-ca8a1e72c66a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:43.607093 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-903bf7f0-07a0-4a84-8fe0-b9f536760877 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 20985 microversion: 2.1 time: 0.200719 Jan 05 15:00:43.611406 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 102/213] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:43 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 20985 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:00:43.614069 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-5a032895-ad49-4a70-920b-fd53e7461d82 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:43.618340 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-5a032895-ad49-4a70-920b-fd53e7461d82 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:43.632950 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5a032895-ad49-4a70-920b-fd53e7461d82 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:43.633530 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5a032895-ad49-4a70-920b-fd53e7461d82 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:43.634388 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5a032895-ad49-4a70-920b-fd53e7461d82 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:43.634822 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5a032895-ad49-4a70-920b-fd53e7461d82 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:43.798912 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-170bddd6-05b2-40c0-a06b-ca8a1e72c66a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:43.806487 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-170bddd6-05b2-40c0-a06b-ca8a1e72c66a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.234528 Jan 05 15:00:43.807293 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 112/214] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:43 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:43.819217 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-5a032895-ad49-4a70-920b-fd53e7461d82 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:43.827390 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-5a032895-ad49-4a70-920b-fd53e7461d82 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1553 microversion: 2.1 time: 0.218534 Jan 05 15:00:43.829212 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 103/215] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:43 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:44.559975 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-575d8d6f-7841-4af4-aace-226e4c5af13a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:44.560998 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-575d8d6f-7841-4af4-aace-226e4c5af13a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:44.573676 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-575d8d6f-7841-4af4-aace-226e4c5af13a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:44.573676 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-575d8d6f-7841-4af4-aace-226e4c5af13a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:44.573676 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-575d8d6f-7841-4af4-aace-226e4c5af13a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:44.573676 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-575d8d6f-7841-4af4-aace-226e4c5af13a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:44.621131 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-cbbbc92c-7cd4-4424-aefe-a24b80e384ed tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:44.622125 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-cbbbc92c-7cd4-4424-aefe-a24b80e384ed tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:44.631027 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cbbbc92c-7cd4-4424-aefe-a24b80e384ed tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:44.631713 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cbbbc92c-7cd4-4424-aefe-a24b80e384ed tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:44.632918 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cbbbc92c-7cd4-4424-aefe-a24b80e384ed tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:44.633389 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cbbbc92c-7cd4-4424-aefe-a24b80e384ed tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:44.697542 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-575d8d6f-7841-4af4-aace-226e4c5af13a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 17717 microversion: 2.20 time: 0.141538 Jan 05 15:00:44.698982 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 113/216] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:44 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 17717 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:00:44.782350 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-cbbbc92c-7cd4-4424-aefe-a24b80e384ed tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 22105 microversion: 2.1 time: 0.166173 Jan 05 15:00:44.782976 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 104/217] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:44 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 22105 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:00:44.824491 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8249d996-476a-48ca-bc74-88eba9e93c5b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:44.825414 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8249d996-476a-48ca-bc74-88eba9e93c5b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:44.832927 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8249d996-476a-48ca-bc74-88eba9e93c5b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:44.833404 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8249d996-476a-48ca-bc74-88eba9e93c5b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:44.834197 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8249d996-476a-48ca-bc74-88eba9e93c5b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:44.834615 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8249d996-476a-48ca-bc74-88eba9e93c5b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:44.844434 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-495002c1-7f60-42cc-a77e-504218aee0c5 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:44.846359 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-495002c1-7f60-42cc-a77e-504218aee0c5 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:44.856567 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-495002c1-7f60-42cc-a77e-504218aee0c5 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:44.857142 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-495002c1-7f60-42cc-a77e-504218aee0c5 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:44.858946 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-495002c1-7f60-42cc-a77e-504218aee0c5 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:44.859480 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-495002c1-7f60-42cc-a77e-504218aee0c5 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:44.933941 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-495002c1-7f60-42cc-a77e-504218aee0c5 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:44.943909 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-495002c1-7f60-42cc-a77e-504218aee0c5 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1511 microversion: 2.1 time: 0.103919 Jan 05 15:00:44.951325 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 105/218] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:44 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1511 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:44.978554 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-632ea3e2-b66f-4449-bef3-1a084937d9e8 req-76f929e0-c893-431e-8e6c-b1a5bcc08389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf86612-a721-4032-9b56-b9828fc658cd", "name": "network-vif-deleted", "tag": "a1de646c-827f-41ad-bab9-8457e33db96d"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:44.985862 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:44.985862 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:00:44.988224 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-632ea3e2-b66f-4449-bef3-1a084937d9e8 req-76f929e0-c893-431e-8e6c-b1a5bcc08389 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:44.988830 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-632ea3e2-b66f-4449-bef3-1a084937d9e8 req-76f929e0-c893-431e-8e6c-b1a5bcc08389 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:45.001356 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-632ea3e2-b66f-4449-bef3-1a084937d9e8 req-76f929e0-c893-431e-8e6c-b1a5bcc08389 service nova] Creating event network-vif-deleted:a1de646c-827f-41ad-bab9-8457e33db96d for instance 6cf86612-a721-4032-9b56-b9828fc658cd on hv-cinder-maste Jan 05 15:00:45.006158 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-632ea3e2-b66f-4449-bef3-1a084937d9e8 req-76f929e0-c893-431e-8e6c-b1a5bcc08389 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032132 Jan 05 15:00:45.007011 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 106/219] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:00:45.043000 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8249d996-476a-48ca-bc74-88eba9e93c5b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:45.050411 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8249d996-476a-48ca-bc74-88eba9e93c5b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.230062 Jan 05 15:00:45.056016 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 114/220] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:44 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:45.709838 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a2048c12-463f-4b36-920c-73c4318ca391 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:45.710832 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a2048c12-463f-4b36-920c-73c4318ca391 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:45.717343 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a2048c12-463f-4b36-920c-73c4318ca391 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:45.717797 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a2048c12-463f-4b36-920c-73c4318ca391 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:45.718617 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a2048c12-463f-4b36-920c-73c4318ca391 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:45.719041 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a2048c12-463f-4b36-920c-73c4318ca391 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:45.794056 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ec03ba00-0734-4b44-a683-67ffa72de139 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:45.794908 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ec03ba00-0734-4b44-a683-67ffa72de139 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:45.801122 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec03ba00-0734-4b44-a683-67ffa72de139 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:45.801569 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec03ba00-0734-4b44-a683-67ffa72de139 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:45.802345 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec03ba00-0734-4b44-a683-67ffa72de139 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:45.802774 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec03ba00-0734-4b44-a683-67ffa72de139 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:45.836086 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a2048c12-463f-4b36-920c-73c4318ca391 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 19342 microversion: 2.20 time: 0.129918 Jan 05 15:00:45.837375 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 107/221] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:45 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 19342 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:00:45.927123 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ec03ba00-0734-4b44-a683-67ffa72de139 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 23220 microversion: 2.1 time: 0.136752 Jan 05 15:00:45.927762 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 115/222] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:45 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 23220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:00:45.967488 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7dcd2b6a-45ee-41be-9a80-48016a7a810c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:45.968193 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7dcd2b6a-45ee-41be-9a80-48016a7a810c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:45.977455 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7dcd2b6a-45ee-41be-9a80-48016a7a810c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:45.977455 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7dcd2b6a-45ee-41be-9a80-48016a7a810c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:45.977455 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7dcd2b6a-45ee-41be-9a80-48016a7a810c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:45.977455 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7dcd2b6a-45ee-41be-9a80-48016a7a810c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:46.008461 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7dcd2b6a-45ee-41be-9a80-48016a7a810c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:46.008907 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7dcd2b6a-45ee-41be-9a80-48016a7a810c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:46.009374 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-7dcd2b6a-45ee-41be-9a80-48016a7a810c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lazy-loading 'fault' on Instance uuid 6cf86612-a721-4032-9b56-b9828fc658cd {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:00:46.050558 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-7dcd2b6a-45ee-41be-9a80-48016a7a810c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c439b7ebe2d44b4ca60a269bd60520e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:46.058330 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7dcd2b6a-45ee-41be-9a80-48016a7a810c tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 200 len: 1351 microversion: 2.1 time: 0.095076 Jan 05 15:00:46.063578 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 108/223] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:45 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:46.068357 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c7c65a35-3b26-486d-844a-347241bf4747 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:46.069048 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c7c65a35-3b26-486d-844a-347241bf4747 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:46.075817 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7c65a35-3b26-486d-844a-347241bf4747 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:46.076259 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7c65a35-3b26-486d-844a-347241bf4747 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:46.077032 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7c65a35-3b26-486d-844a-347241bf4747 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:46.077530 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7c65a35-3b26-486d-844a-347241bf4747 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:46.212719 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-c7c65a35-3b26-486d-844a-347241bf4747 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:46.220039 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c7c65a35-3b26-486d-844a-347241bf4747 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.155704 Jan 05 15:00:46.220584 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 116/224] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:46 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:46.848460 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d0d295bf-229e-4727-b1c9-54b2bc19bea5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:46.849475 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d0d295bf-229e-4727-b1c9-54b2bc19bea5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:46.856563 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d0d295bf-229e-4727-b1c9-54b2bc19bea5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:46.857017 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d0d295bf-229e-4727-b1c9-54b2bc19bea5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:46.857824 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d0d295bf-229e-4727-b1c9-54b2bc19bea5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:46.858311 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d0d295bf-229e-4727-b1c9-54b2bc19bea5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:46.939028 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-659a1cac-72e7-4751-85d6-5d561771bc07 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:46.939984 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-659a1cac-72e7-4751-85d6-5d561771bc07 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:46.946530 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-659a1cac-72e7-4751-85d6-5d561771bc07 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:46.947012 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-659a1cac-72e7-4751-85d6-5d561771bc07 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:46.947825 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-659a1cac-72e7-4751-85d6-5d561771bc07 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:46.948261 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-659a1cac-72e7-4751-85d6-5d561771bc07 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:46.962238 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d0d295bf-229e-4727-b1c9-54b2bc19bea5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 20985 microversion: 2.20 time: 0.117386 Jan 05 15:00:46.965954 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 109/225] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:46 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 20985 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:00:47.071087 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-659a1cac-72e7-4751-85d6-5d561771bc07 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 24294 microversion: 2.1 time: 0.135640 Jan 05 15:00:47.071849 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 117/226] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:46 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 24294 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:00:47.076139 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-447af70c-dbb0-4df2-99cd-2f147c2b1ee7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:47.076836 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-447af70c-dbb0-4df2-99cd-2f147c2b1ee7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:47.085800 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-447af70c-dbb0-4df2-99cd-2f147c2b1ee7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:47.085800 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-447af70c-dbb0-4df2-99cd-2f147c2b1ee7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:47.086203 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-447af70c-dbb0-4df2-99cd-2f147c2b1ee7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:47.086634 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-447af70c-dbb0-4df2-99cd-2f147c2b1ee7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:47.101355 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-447af70c-dbb0-4df2-99cd-2f147c2b1ee7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] HTTP exception thrown: Instance 6cf86612-a721-4032-9b56-b9828fc658cd could not be found. Jan 05 15:00:47.101941 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-447af70c-dbb0-4df2-99cd-2f147c2b1ee7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Returning 404 to user: Instance 6cf86612-a721-4032-9b56-b9828fc658cd could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:00:47.102764 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-447af70c-dbb0-4df2-99cd-2f147c2b1ee7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 404 len: 111 microversion: 2.1 time: 0.030768 Jan 05 15:00:47.103512 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 110/227] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:47 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 05 15:00:47.219636 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3fd9181d-7eaf-497e-87ec-338c1b0c9b78 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:47.223357 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3fd9181d-7eaf-497e-87ec-338c1b0c9b78 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:47.227393 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fd9181d-7eaf-497e-87ec-338c1b0c9b78 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:47.227843 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fd9181d-7eaf-497e-87ec-338c1b0c9b78 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:47.228690 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fd9181d-7eaf-497e-87ec-338c1b0c9b78 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:47.229142 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fd9181d-7eaf-497e-87ec-338c1b0c9b78 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:47.237811 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b3dc845f-cd89-40d2-bdd6-35f70ea44d15 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:47.238447 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b3dc845f-cd89-40d2-bdd6-35f70ea44d15 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:47.242249 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-3fd9181d-7eaf-497e-87ec-338c1b0c9b78 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] HTTP exception thrown: Instance 6cf86612-a721-4032-9b56-b9828fc658cd could not be found. Jan 05 15:00:47.242885 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3fd9181d-7eaf-497e-87ec-338c1b0c9b78 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Returning 404 to user: Instance 6cf86612-a721-4032-9b56-b9828fc658cd could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:00:47.243753 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3fd9181d-7eaf-497e-87ec-338c1b0c9b78 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028312 Jan 05 15:00:47.244293 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 118/228] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:00:47 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:00:47.244779 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b3dc845f-cd89-40d2-bdd6-35f70ea44d15 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:47.245275 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b3dc845f-cd89-40d2-bdd6-35f70ea44d15 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:47.246056 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b3dc845f-cd89-40d2-bdd6-35f70ea44d15 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:47.246520 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b3dc845f-cd89-40d2-bdd6-35f70ea44d15 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:47.396133 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b3dc845f-cd89-40d2-bdd6-35f70ea44d15 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:47.404418 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b3dc845f-cd89-40d2-bdd6-35f70ea44d15 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.170258 Jan 05 15:00:47.406458 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 111/229] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:47 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:47.974273 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-35dca0e8-1572-4c00-b2d0-5d6145787cf6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:47.975185 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-35dca0e8-1572-4c00-b2d0-5d6145787cf6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:47.981851 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35dca0e8-1572-4c00-b2d0-5d6145787cf6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:47.982298 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35dca0e8-1572-4c00-b2d0-5d6145787cf6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:47.983068 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35dca0e8-1572-4c00-b2d0-5d6145787cf6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:47.984196 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35dca0e8-1572-4c00-b2d0-5d6145787cf6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:48.082778 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-098c6632-43a9-487f-ba72-53a8f4a3f7e5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:48.083692 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-098c6632-43a9-487f-ba72-53a8f4a3f7e5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:48.090120 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-098c6632-43a9-487f-ba72-53a8f4a3f7e5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:48.090566 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-098c6632-43a9-487f-ba72-53a8f4a3f7e5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:48.091347 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-098c6632-43a9-487f-ba72-53a8f4a3f7e5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:48.091778 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-098c6632-43a9-487f-ba72-53a8f4a3f7e5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:48.098161 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-35dca0e8-1572-4c00-b2d0-5d6145787cf6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 22113 microversion: 2.20 time: 0.127553 Jan 05 15:00:48.102951 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 119/230] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:47 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 22113 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:00:48.209163 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-098c6632-43a9-487f-ba72-53a8f4a3f7e5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 24913 microversion: 2.1 time: 0.129939 Jan 05 15:00:48.209865 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 112/231] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:48 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 24913 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:00:48.429970 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-693bc59a-7c1f-4db6-bb38-2983adccfc3f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:48.430727 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-693bc59a-7c1f-4db6-bb38-2983adccfc3f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:48.438207 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-693bc59a-7c1f-4db6-bb38-2983adccfc3f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:48.438650 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-693bc59a-7c1f-4db6-bb38-2983adccfc3f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:48.439418 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-693bc59a-7c1f-4db6-bb38-2983adccfc3f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:48.439844 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-693bc59a-7c1f-4db6-bb38-2983adccfc3f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:48.583402 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-693bc59a-7c1f-4db6-bb38-2983adccfc3f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:48.591173 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-693bc59a-7c1f-4db6-bb38-2983adccfc3f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.165460 Jan 05 15:00:48.591829 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 120/232] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:48 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:48.722684 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2659627c-1591-4a9c-aeb8-d5d9863f1a9a tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:48.723270 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2659627c-1591-4a9c-aeb8-d5d9863f1a9a tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:48.730347 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2659627c-1591-4a9c-aeb8-d5d9863f1a9a tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:48.730794 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2659627c-1591-4a9c-aeb8-d5d9863f1a9a tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:48.733126 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2659627c-1591-4a9c-aeb8-d5d9863f1a9a tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:48.733126 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2659627c-1591-4a9c-aeb8-d5d9863f1a9a tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:48.746388 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-2659627c-1591-4a9c-aeb8-d5d9863f1a9a tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] HTTP exception thrown: Instance 6cf86612-a721-4032-9b56-b9828fc658cd could not be found. Jan 05 15:00:48.746960 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2659627c-1591-4a9c-aeb8-d5d9863f1a9a tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Returning 404 to user: Instance 6cf86612-a721-4032-9b56-b9828fc658cd could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:00:48.747776 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2659627c-1591-4a9c-aeb8-d5d9863f1a9a tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 404 len: 111 microversion: 2.1 time: 0.029205 Jan 05 15:00:48.748283 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 113/233] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:00:48 2022] DELETE /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 05 15:00:48.756119 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fd1eeaf2-48b2-4e32-a214-e6faa567069e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:48.756814 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fd1eeaf2-48b2-4e32-a214-e6faa567069e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] [instance: 6cf86612-a721-4032-9b56-b9828fc658cd] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:48.762993 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd1eeaf2-48b2-4e32-a214-e6faa567069e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:48.763915 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd1eeaf2-48b2-4e32-a214-e6faa567069e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:48.764378 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd1eeaf2-48b2-4e32-a214-e6faa567069e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:48.764863 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd1eeaf2-48b2-4e32-a214-e6faa567069e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:48.779617 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-fd1eeaf2-48b2-4e32-a214-e6faa567069e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] HTTP exception thrown: Instance 6cf86612-a721-4032-9b56-b9828fc658cd could not be found. Jan 05 15:00:48.779962 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fd1eeaf2-48b2-4e32-a214-e6faa567069e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Returning 404 to user: Instance 6cf86612-a721-4032-9b56-b9828fc658cd could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:00:48.781349 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fd1eeaf2-48b2-4e32-a214-e6faa567069e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd" status: 404 len: 111 microversion: 2.1 time: 0.029018 Jan 05 15:00:48.781903 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 121/234] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:48 2022] GET /compute/v2.1/servers/6cf86612-a721-4032-9b56-b9828fc658cd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:00:49.110766 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-9fe153df-184e-484a-b843-98b5108d9e99 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:49.111681 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-9fe153df-184e-484a-b843-98b5108d9e99 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:49.117988 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9fe153df-184e-484a-b843-98b5108d9e99 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:49.118648 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9fe153df-184e-484a-b843-98b5108d9e99 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:49.119581 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9fe153df-184e-484a-b843-98b5108d9e99 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:49.127348 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9fe153df-184e-484a-b843-98b5108d9e99 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:49.221441 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-67a2a02a-e39e-430a-8cf3-8965defa5882 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:49.222368 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-67a2a02a-e39e-430a-8cf3-8965defa5882 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:49.228884 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67a2a02a-e39e-430a-8cf3-8965defa5882 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:49.229370 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67a2a02a-e39e-430a-8cf3-8965defa5882 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:49.230420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67a2a02a-e39e-430a-8cf3-8965defa5882 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:49.230859 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67a2a02a-e39e-430a-8cf3-8965defa5882 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:49.238383 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-9fe153df-184e-484a-b843-98b5108d9e99 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 23224 microversion: 2.20 time: 0.131378 Jan 05 15:00:49.239805 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 114/235] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:49 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 23224 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:00:49.354581 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-67a2a02a-e39e-430a-8cf3-8965defa5882 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 25853 microversion: 2.1 time: 0.136593 Jan 05 15:00:49.359408 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 122/236] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:49 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 25853 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:00:49.608313 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b2d3f0f1-d9a7-40a2-83c8-063accf2c28b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:49.609720 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b2d3f0f1-d9a7-40a2-83c8-063accf2c28b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:49.616617 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b2d3f0f1-d9a7-40a2-83c8-063accf2c28b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:49.617081 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b2d3f0f1-d9a7-40a2-83c8-063accf2c28b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:49.617861 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b2d3f0f1-d9a7-40a2-83c8-063accf2c28b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:49.618297 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b2d3f0f1-d9a7-40a2-83c8-063accf2c28b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:49.760707 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b2d3f0f1-d9a7-40a2-83c8-063accf2c28b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:49.770840 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b2d3f0f1-d9a7-40a2-83c8-063accf2c28b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.166795 Jan 05 15:00:49.771416 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 115/237] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:49 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:50.251372 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-77cadf34-8a48-4cb2-8199-327d9313fb80 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:50.252364 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-77cadf34-8a48-4cb2-8199-327d9313fb80 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:50.259550 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77cadf34-8a48-4cb2-8199-327d9313fb80 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:50.260086 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77cadf34-8a48-4cb2-8199-327d9313fb80 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:50.260953 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77cadf34-8a48-4cb2-8199-327d9313fb80 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:50.261498 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77cadf34-8a48-4cb2-8199-327d9313fb80 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:50.366347 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-77cadf34-8a48-4cb2-8199-327d9313fb80 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 24117 microversion: 2.20 time: 0.119354 Jan 05 15:00:50.371451 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 123/238] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:50 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 24117 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:00:50.371629 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-da005fd0-2f6f-4a8a-9bdc-38691920e3ca tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:50.371629 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-da005fd0-2f6f-4a8a-9bdc-38691920e3ca tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:50.378813 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-da005fd0-2f6f-4a8a-9bdc-38691920e3ca tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:50.379266 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-da005fd0-2f6f-4a8a-9bdc-38691920e3ca tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:50.380073 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-da005fd0-2f6f-4a8a-9bdc-38691920e3ca tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:50.380537 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-da005fd0-2f6f-4a8a-9bdc-38691920e3ca tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:50.494776 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-da005fd0-2f6f-4a8a-9bdc-38691920e3ca tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 26465 microversion: 2.1 time: 0.131306 Jan 05 15:00:50.495427 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 116/239] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:50 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 26465 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:00:50.787325 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d4553525-b1f5-460b-8e0c-310e8f231ef6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:50.788016 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d4553525-b1f5-460b-8e0c-310e8f231ef6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:50.796869 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4553525-b1f5-460b-8e0c-310e8f231ef6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:50.797565 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4553525-b1f5-460b-8e0c-310e8f231ef6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:50.798327 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4553525-b1f5-460b-8e0c-310e8f231ef6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:50.798759 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4553525-b1f5-460b-8e0c-310e8f231ef6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:50.938835 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d4553525-b1f5-460b-8e0c-310e8f231ef6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:50.946509 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d4553525-b1f5-460b-8e0c-310e8f231ef6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.163114 Jan 05 15:00:50.952286 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 124/240] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:50 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:51.379657 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-08bbadcd-ae9e-47ea-8ed3-a642b0eeee0f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:51.381406 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-08bbadcd-ae9e-47ea-8ed3-a642b0eeee0f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:51.388096 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-08bbadcd-ae9e-47ea-8ed3-a642b0eeee0f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:51.388540 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-08bbadcd-ae9e-47ea-8ed3-a642b0eeee0f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:51.389350 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-08bbadcd-ae9e-47ea-8ed3-a642b0eeee0f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:51.390282 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-08bbadcd-ae9e-47ea-8ed3-a642b0eeee0f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:51.506196 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d6138bbb-cf8b-48cb-bf1a-7f06f3b295be tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:51.507219 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d6138bbb-cf8b-48cb-bf1a-7f06f3b295be tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:51.513653 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6138bbb-cf8b-48cb-bf1a-7f06f3b295be tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:51.514188 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6138bbb-cf8b-48cb-bf1a-7f06f3b295be tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:51.515612 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6138bbb-cf8b-48cb-bf1a-7f06f3b295be tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:51.516114 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6138bbb-cf8b-48cb-bf1a-7f06f3b295be tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:54.129872 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-08bbadcd-ae9e-47ea-8ed3-a642b0eeee0f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 26808 microversion: 2.20 time: 2.754370 Jan 05 15:00:54.133726 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 117/241] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:51 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 26808 bytes in 2756 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:00:54.135616 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1e5fd256-1634-4c3b-9aca-07460120b3d5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:54.136363 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1e5fd256-1634-4c3b-9aca-07460120b3d5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:54.144350 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1e5fd256-1634-4c3b-9aca-07460120b3d5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:54.144808 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1e5fd256-1634-4c3b-9aca-07460120b3d5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:54.145618 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1e5fd256-1634-4c3b-9aca-07460120b3d5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:54.146140 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1e5fd256-1634-4c3b-9aca-07460120b3d5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:54.165685 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d6138bbb-cf8b-48cb-bf1a-7f06f3b295be tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 27753 microversion: 2.1 time: 2.662960 Jan 05 15:00:54.169744 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 125/242] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:51 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 27753 bytes in 2665 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:00:54.277509 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-1e5fd256-1634-4c3b-9aca-07460120b3d5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:54.286143 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1e5fd256-1634-4c3b-9aca-07460120b3d5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.154344 Jan 05 15:00:54.286839 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 118/243] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:54 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:55.142311 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-846c7a33-3e1a-4707-b798-7bdcf30c7c5b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:55.143248 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-846c7a33-3e1a-4707-b798-7bdcf30c7c5b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:55.150099 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-846c7a33-3e1a-4707-b798-7bdcf30c7c5b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:55.150540 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-846c7a33-3e1a-4707-b798-7bdcf30c7c5b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:55.151316 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-846c7a33-3e1a-4707-b798-7bdcf30c7c5b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:55.151745 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-846c7a33-3e1a-4707-b798-7bdcf30c7c5b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:55.177418 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-55474316-f228-4967-9c3d-f4510a1b9df5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:55.178423 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-55474316-f228-4967-9c3d-f4510a1b9df5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:55.185685 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-55474316-f228-4967-9c3d-f4510a1b9df5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:55.186126 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-55474316-f228-4967-9c3d-f4510a1b9df5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:55.186894 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-55474316-f228-4967-9c3d-f4510a1b9df5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:55.187321 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-55474316-f228-4967-9c3d-f4510a1b9df5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:55.268799 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-846c7a33-3e1a-4707-b798-7bdcf30c7c5b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 27340 microversion: 2.20 time: 0.130874 Jan 05 15:00:55.272883 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 126/244] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:55 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 27340 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:00:55.302587 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ffe7b38e-47fc-40ab-b89d-5f7f418b5e55 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:55.303282 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ffe7b38e-47fc-40ab-b89d-5f7f418b5e55 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:55.315162 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-55474316-f228-4967-9c3d-f4510a1b9df5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 28181 microversion: 2.1 time: 0.139200 Jan 05 15:00:55.315162 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 119/245] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:55 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 28181 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:00:55.316708 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffe7b38e-47fc-40ab-b89d-5f7f418b5e55 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:55.317185 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffe7b38e-47fc-40ab-b89d-5f7f418b5e55 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:55.318011 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffe7b38e-47fc-40ab-b89d-5f7f418b5e55 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:55.318450 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffe7b38e-47fc-40ab-b89d-5f7f418b5e55 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:55.475448 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-ffe7b38e-47fc-40ab-b89d-5f7f418b5e55 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:55.484962 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ffe7b38e-47fc-40ab-b89d-5f7f418b5e55 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.186262 Jan 05 15:00:55.485662 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 127/246] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:55 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:00:56.280571 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3259aa30-9c66-488a-8f54-345e1c155f21 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:56.281580 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3259aa30-9c66-488a-8f54-345e1c155f21 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:56.288336 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3259aa30-9c66-488a-8f54-345e1c155f21 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:56.288787 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3259aa30-9c66-488a-8f54-345e1c155f21 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:56.289589 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3259aa30-9c66-488a-8f54-345e1c155f21 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:56.290054 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3259aa30-9c66-488a-8f54-345e1c155f21 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:56.325325 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b7ecc404-e5e3-4bc2-9ed9-927f35f59cfc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:56.326278 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b7ecc404-e5e3-4bc2-9ed9-927f35f59cfc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:56.333392 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7ecc404-e5e3-4bc2-9ed9-927f35f59cfc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:56.333878 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7ecc404-e5e3-4bc2-9ed9-927f35f59cfc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:56.336233 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7ecc404-e5e3-4bc2-9ed9-927f35f59cfc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:56.336233 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7ecc404-e5e3-4bc2-9ed9-927f35f59cfc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:56.386915 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3259aa30-9c66-488a-8f54-345e1c155f21 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 27746 microversion: 2.20 time: 0.110314 Jan 05 15:00:56.387992 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 120/247] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:56 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 27746 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:00:56.452725 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b7ecc404-e5e3-4bc2-9ed9-927f35f59cfc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 28181 microversion: 2.1 time: 0.130922 Jan 05 15:00:56.456589 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 128/248] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:56 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 28181 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:00:56.502480 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-85227f11-56ce-464e-8827-2d433060018e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:56.503879 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-85227f11-56ce-464e-8827-2d433060018e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:56.511668 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-85227f11-56ce-464e-8827-2d433060018e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:56.512120 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-85227f11-56ce-464e-8827-2d433060018e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:56.513590 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-85227f11-56ce-464e-8827-2d433060018e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:56.513672 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-85227f11-56ce-464e-8827-2d433060018e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:56.660044 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-85227f11-56ce-464e-8827-2d433060018e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:56.667559 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-85227f11-56ce-464e-8827-2d433060018e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.169676 Jan 05 15:00:56.668271 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 121/249] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:56 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:57.398574 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f8757ae3-c3d8-40f9-a41a-f9bc9f5ef0c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:57.399661 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f8757ae3-c3d8-40f9-a41a-f9bc9f5ef0c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:57.407162 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8757ae3-c3d8-40f9-a41a-f9bc9f5ef0c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:57.407606 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8757ae3-c3d8-40f9-a41a-f9bc9f5ef0c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:57.408393 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8757ae3-c3d8-40f9-a41a-f9bc9f5ef0c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:57.408820 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8757ae3-c3d8-40f9-a41a-f9bc9f5ef0c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:57.468614 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-123df15a-07bd-4dd3-8dd9-753fceb9eabf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:57.469597 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-123df15a-07bd-4dd3-8dd9-753fceb9eabf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:57.475459 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-123df15a-07bd-4dd3-8dd9-753fceb9eabf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:57.475901 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-123df15a-07bd-4dd3-8dd9-753fceb9eabf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:57.476671 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-123df15a-07bd-4dd3-8dd9-753fceb9eabf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:57.477121 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-123df15a-07bd-4dd3-8dd9-753fceb9eabf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:57.520539 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f8757ae3-c3d8-40f9-a41a-f9bc9f5ef0c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 27991 microversion: 2.20 time: 0.125869 Jan 05 15:00:57.521390 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 129/250] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:57 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 27991 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:00:57.596620 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-123df15a-07bd-4dd3-8dd9-753fceb9eabf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 28181 microversion: 2.1 time: 0.134143 Jan 05 15:00:57.599800 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 122/251] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:57 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 28181 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:00:57.685457 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-913fa177-5e5f-41f5-9c78-2b9141e55147 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:57.686147 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-913fa177-5e5f-41f5-9c78-2b9141e55147 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:57.693810 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-913fa177-5e5f-41f5-9c78-2b9141e55147 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:57.694266 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-913fa177-5e5f-41f5-9c78-2b9141e55147 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:57.695042 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-913fa177-5e5f-41f5-9c78-2b9141e55147 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:57.695643 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-913fa177-5e5f-41f5-9c78-2b9141e55147 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:57.834494 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-913fa177-5e5f-41f5-9c78-2b9141e55147 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:57.842106 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-913fa177-5e5f-41f5-9c78-2b9141e55147 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.160762 Jan 05 15:00:57.842675 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 130/252] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:57 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:58.534728 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2bdbf827-5b30-4532-8d3c-d221602a140b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:58.535733 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2bdbf827-5b30-4532-8d3c-d221602a140b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:58.549524 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2bdbf827-5b30-4532-8d3c-d221602a140b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:58.550114 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2bdbf827-5b30-4532-8d3c-d221602a140b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:58.550761 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2bdbf827-5b30-4532-8d3c-d221602a140b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:58.551189 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2bdbf827-5b30-4532-8d3c-d221602a140b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:58.607621 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63096d48-d82c-40ad-86e0-5082506e5178 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:58.608612 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-63096d48-d82c-40ad-86e0-5082506e5178 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:58.614747 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63096d48-d82c-40ad-86e0-5082506e5178 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:58.615188 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63096d48-d82c-40ad-86e0-5082506e5178 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:58.615957 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63096d48-d82c-40ad-86e0-5082506e5178 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:58.616602 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63096d48-d82c-40ad-86e0-5082506e5178 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:58.667758 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2bdbf827-5b30-4532-8d3c-d221602a140b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 28177 microversion: 2.20 time: 0.136953 Jan 05 15:00:58.669417 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 123/253] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:58 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 28177 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:00:58.737192 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-63096d48-d82c-40ad-86e0-5082506e5178 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 28472 microversion: 2.1 time: 0.133308 Jan 05 15:00:58.738638 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 131/254] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:58 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 28472 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:00:58.858973 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f9ee16e3-065c-40a3-9398-61d99a5b868b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:00:58.859725 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f9ee16e3-065c-40a3-9398-61d99a5b868b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:58.866558 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f9ee16e3-065c-40a3-9398-61d99a5b868b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:58.867043 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f9ee16e3-065c-40a3-9398-61d99a5b868b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:58.867894 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f9ee16e3-065c-40a3-9398-61d99a5b868b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:58.868403 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f9ee16e3-065c-40a3-9398-61d99a5b868b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:58.996697 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f9ee16e3-065c-40a3-9398-61d99a5b868b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:00:59.005201 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f9ee16e3-065c-40a3-9398-61d99a5b868b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.150978 Jan 05 15:00:59.005767 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 124/255] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:00:58 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:00:59.680320 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6736d01c-b438-4279-9849-93323dfbefc7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:59.682715 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6736d01c-b438-4279-9849-93323dfbefc7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:59.691215 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6736d01c-b438-4279-9849-93323dfbefc7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:59.694622 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6736d01c-b438-4279-9849-93323dfbefc7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:59.694622 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6736d01c-b438-4279-9849-93323dfbefc7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:59.694622 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6736d01c-b438-4279-9849-93323dfbefc7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:59.748541 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6f8a2f01-8aa3-4e22-938f-84ccbe3a06b8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:00:59.749964 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-6f8a2f01-8aa3-4e22-938f-84ccbe3a06b8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:00:59.756204 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6f8a2f01-8aa3-4e22-938f-84ccbe3a06b8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:59.756641 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6f8a2f01-8aa3-4e22-938f-84ccbe3a06b8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:59.757498 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6f8a2f01-8aa3-4e22-938f-84ccbe3a06b8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:00:59.757963 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6f8a2f01-8aa3-4e22-938f-84ccbe3a06b8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:00:59.817340 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6736d01c-b438-4279-9849-93323dfbefc7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 28177 microversion: 2.20 time: 0.141019 Jan 05 15:00:59.818057 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 132/256] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:00:59 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 28177 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:00:59.902423 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6f8a2f01-8aa3-4e22-938f-84ccbe3a06b8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 28640 microversion: 2.1 time: 0.156919 Jan 05 15:00:59.908863 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 125/257] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:00:59 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 28640 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:01:00.022913 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-84735d23-bd00-41d7-a55e-f3a1754c499e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:00.023258 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-84735d23-bd00-41d7-a55e-f3a1754c499e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:00.030025 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84735d23-bd00-41d7-a55e-f3a1754c499e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:00.030475 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84735d23-bd00-41d7-a55e-f3a1754c499e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:00.031293 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84735d23-bd00-41d7-a55e-f3a1754c499e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:00.031728 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84735d23-bd00-41d7-a55e-f3a1754c499e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:00.178951 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-84735d23-bd00-41d7-a55e-f3a1754c499e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:00.186395 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-84735d23-bd00-41d7-a55e-f3a1754c499e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.168062 Jan 05 15:01:00.187087 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 133/258] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:00 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:00.830332 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d1d22820-435b-4470-bb04-0ef85633a017 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:00.831296 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d1d22820-435b-4470-bb04-0ef85633a017 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:00.840684 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d1d22820-435b-4470-bb04-0ef85633a017 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:00.841457 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d1d22820-435b-4470-bb04-0ef85633a017 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:00.842524 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d1d22820-435b-4470-bb04-0ef85633a017 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:00.843313 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d1d22820-435b-4470-bb04-0ef85633a017 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:00.917046 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9f8e6f8f-610c-4cef-ac14-72a209a910df tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:00.921483 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9f8e6f8f-610c-4cef-ac14-72a209a910df tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:00.927389 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f8e6f8f-610c-4cef-ac14-72a209a910df tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:00.927735 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f8e6f8f-610c-4cef-ac14-72a209a910df tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:00.932420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f8e6f8f-610c-4cef-ac14-72a209a910df tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:00.932975 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f8e6f8f-610c-4cef-ac14-72a209a910df tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:00.976647 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d1d22820-435b-4470-bb04-0ef85633a017 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 28177 microversion: 2.20 time: 0.150635 Jan 05 15:01:00.978751 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 126/259] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:00 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 28177 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:01:01.204936 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c6bc194b-fd00-4e70-bc71-f15bbadb4c50 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:01.205739 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c6bc194b-fd00-4e70-bc71-f15bbadb4c50 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:01.212607 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c6bc194b-fd00-4e70-bc71-f15bbadb4c50 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:01.213310 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c6bc194b-fd00-4e70-bc71-f15bbadb4c50 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:01.214109 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c6bc194b-fd00-4e70-bc71-f15bbadb4c50 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:01.214538 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c6bc194b-fd00-4e70-bc71-f15bbadb4c50 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:01.350249 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9f8e6f8f-610c-4cef-ac14-72a209a910df tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 28640 microversion: 2.1 time: 0.437974 Jan 05 15:01:01.350972 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 134/260] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:01:00 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 28640 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:01:01.371466 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c6bc194b-fd00-4e70-bc71-f15bbadb4c50 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:01.378816 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c6bc194b-fd00-4e70-bc71-f15bbadb4c50 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.180017 Jan 05 15:01:01.379390 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 127/261] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:01 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:01.990100 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d8a0bfc0-19eb-488b-8fa5-b29123ece8ce tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:01.991111 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d8a0bfc0-19eb-488b-8fa5-b29123ece8ce tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:01.998394 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8a0bfc0-19eb-488b-8fa5-b29123ece8ce tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:01.999566 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8a0bfc0-19eb-488b-8fa5-b29123ece8ce tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:02.000207 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8a0bfc0-19eb-488b-8fa5-b29123ece8ce tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:02.000643 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8a0bfc0-19eb-488b-8fa5-b29123ece8ce tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:02.207314 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d8a0bfc0-19eb-488b-8fa5-b29123ece8ce tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 28467 microversion: 2.20 time: 0.221069 Jan 05 15:01:02.208584 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 135/262] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:01 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 28467 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:01:02.362895 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-75b4bc67-3d2e-4d10-8017-ee7f53de0726 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:02.363840 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-75b4bc67-3d2e-4d10-8017-ee7f53de0726 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:02.370299 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-75b4bc67-3d2e-4d10-8017-ee7f53de0726 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:02.370674 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-75b4bc67-3d2e-4d10-8017-ee7f53de0726 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:02.371465 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-75b4bc67-3d2e-4d10-8017-ee7f53de0726 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:02.372173 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-75b4bc67-3d2e-4d10-8017-ee7f53de0726 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:02.396416 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-641637f5-7a16-46ab-b919-4c39d8fbcd16 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:02.397131 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-641637f5-7a16-46ab-b919-4c39d8fbcd16 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:02.407327 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-641637f5-7a16-46ab-b919-4c39d8fbcd16 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:02.408030 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-641637f5-7a16-46ab-b919-4c39d8fbcd16 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:02.409123 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-641637f5-7a16-46ab-b919-4c39d8fbcd16 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:02.409559 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-641637f5-7a16-46ab-b919-4c39d8fbcd16 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:02.478196 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-75b4bc67-3d2e-4d10-8017-ee7f53de0726 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 28640 microversion: 2.1 time: 0.119119 Jan 05 15:01:02.482491 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 128/263] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:01:02 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 28640 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:01:02.583407 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-641637f5-7a16-46ab-b919-4c39d8fbcd16 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:02.591187 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-641637f5-7a16-46ab-b919-4c39d8fbcd16 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1523 microversion: 2.1 time: 0.198933 Jan 05 15:01:02.591783 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 136/264] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:02 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:03.220447 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-cf1a9a7d-e9cf-43e6-8b69-ac440e0a8f7f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:03.221549 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-cf1a9a7d-e9cf-43e6-8b69-ac440e0a8f7f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:03.231122 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cf1a9a7d-e9cf-43e6-8b69-ac440e0a8f7f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:03.231948 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cf1a9a7d-e9cf-43e6-8b69-ac440e0a8f7f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:03.235798 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cf1a9a7d-e9cf-43e6-8b69-ac440e0a8f7f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:03.235798 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cf1a9a7d-e9cf-43e6-8b69-ac440e0a8f7f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:03.365800 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-cf1a9a7d-e9cf-43e6-8b69-ac440e0a8f7f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 28592 microversion: 2.20 time: 0.150149 Jan 05 15:01:03.366443 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 129/265] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:03 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 28592 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:01:03.490700 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-068c7658-d593-4599-9be3-8e768b040203 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:03.492609 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-068c7658-d593-4599-9be3-8e768b040203 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:03.506865 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-068c7658-d593-4599-9be3-8e768b040203 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:03.506865 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-068c7658-d593-4599-9be3-8e768b040203 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:03.506865 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-068c7658-d593-4599-9be3-8e768b040203 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:03.506865 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-068c7658-d593-4599-9be3-8e768b040203 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:03.608326 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d98c6c0f-797b-4d42-9a2d-6b1e346b4b5b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:03.609020 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d98c6c0f-797b-4d42-9a2d-6b1e346b4b5b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:03.614834 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-068c7658-d593-4599-9be3-8e768b040203 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 28640 microversion: 2.1 time: 0.129148 Jan 05 15:01:03.615549 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 137/266] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:01:03 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 28640 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:01:03.615924 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d98c6c0f-797b-4d42-9a2d-6b1e346b4b5b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:03.616372 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d98c6c0f-797b-4d42-9a2d-6b1e346b4b5b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:03.617181 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d98c6c0f-797b-4d42-9a2d-6b1e346b4b5b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:03.617610 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d98c6c0f-797b-4d42-9a2d-6b1e346b4b5b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:03.753977 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d98c6c0f-797b-4d42-9a2d-6b1e346b4b5b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:03.761779 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d98c6c0f-797b-4d42-9a2d-6b1e346b4b5b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1503 microversion: 2.1 time: 0.157770 Jan 05 15:01:03.783479 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f38ecab8-1d5f-4efd-9b5c-49e643397414 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:03.784668 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f38ecab8-1d5f-4efd-9b5c-49e643397414 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:03.796527 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f38ecab8-1d5f-4efd-9b5c-49e643397414 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:03.797426 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f38ecab8-1d5f-4efd-9b5c-49e643397414 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:03.798533 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f38ecab8-1d5f-4efd-9b5c-49e643397414 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:03.798799 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 130/267] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:03 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:03.799473 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f38ecab8-1d5f-4efd-9b5c-49e643397414 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:03.958718 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-f38ecab8-1d5f-4efd-9b5c-49e643397414 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:03.966319 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f38ecab8-1d5f-4efd-9b5c-49e643397414 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1515 microversion: 2.1 time: 0.187538 Jan 05 15:01:03.966960 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 138/268] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:03 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:04.377621 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ab1cc2ba-cfe1-43d4-8831-aa5074c414a9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:04.378563 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ab1cc2ba-cfe1-43d4-8831-aa5074c414a9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:04.384548 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ab1cc2ba-cfe1-43d4-8831-aa5074c414a9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:04.384996 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ab1cc2ba-cfe1-43d4-8831-aa5074c414a9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:04.385799 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ab1cc2ba-cfe1-43d4-8831-aa5074c414a9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:04.386235 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ab1cc2ba-cfe1-43d4-8831-aa5074c414a9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:04.492259 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ab1cc2ba-cfe1-43d4-8831-aa5074c414a9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 28635 microversion: 2.20 time: 0.118139 Jan 05 15:01:04.496235 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 131/269] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:04 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 28635 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:01:04.627043 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b232bcaf-7054-4fd0-8c94-6a9b32330f66 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:04.627991 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b232bcaf-7054-4fd0-8c94-6a9b32330f66 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:04.634169 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b232bcaf-7054-4fd0-8c94-6a9b32330f66 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:04.634612 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b232bcaf-7054-4fd0-8c94-6a9b32330f66 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:04.635384 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b232bcaf-7054-4fd0-8c94-6a9b32330f66 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:04.635849 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b232bcaf-7054-4fd0-8c94-6a9b32330f66 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:04.723060 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b232bcaf-7054-4fd0-8c94-6a9b32330f66 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 28640 microversion: 2.1 time: 0.100140 Jan 05 15:01:04.723721 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 139/270] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:01:04 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 28640 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:01:05.504499 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a99661dd-173d-4477-b011-3075a5a0df44 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:05.505610 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a99661dd-173d-4477-b011-3075a5a0df44 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:05.512634 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a99661dd-173d-4477-b011-3075a5a0df44 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:05.512926 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a99661dd-173d-4477-b011-3075a5a0df44 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:05.513739 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a99661dd-173d-4477-b011-3075a5a0df44 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:05.514175 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a99661dd-173d-4477-b011-3075a5a0df44 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:05.735616 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-380fb7f7-36c4-4f1d-bdf9-9782b81ee4f4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:05.736624 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-380fb7f7-36c4-4f1d-bdf9-9782b81ee4f4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:05.744353 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-380fb7f7-36c4-4f1d-bdf9-9782b81ee4f4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:05.744803 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-380fb7f7-36c4-4f1d-bdf9-9782b81ee4f4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:05.745624 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-380fb7f7-36c4-4f1d-bdf9-9782b81ee4f4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:05.746056 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-380fb7f7-36c4-4f1d-bdf9-9782b81ee4f4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:07.915842 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a99661dd-173d-4477-b011-3075a5a0df44 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 28635 microversion: 2.20 time: 2.415266 Jan 05 15:01:07.917380 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 132/271] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:05 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 28635 bytes in 2418 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:01:07.956436 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-380fb7f7-36c4-4f1d-bdf9-9782b81ee4f4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 34653 microversion: 2.1 time: 2.225006 Jan 05 15:01:07.959361 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 140/272] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:01:05 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 34653 bytes in 2227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:01:08.928961 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a0a08450-3fcb-42d6-ae79-589a51629f7d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:08.930420 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a0a08450-3fcb-42d6-ae79-589a51629f7d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:08.938949 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a0a08450-3fcb-42d6-ae79-589a51629f7d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:08.940167 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a0a08450-3fcb-42d6-ae79-589a51629f7d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:08.941415 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a0a08450-3fcb-42d6-ae79-589a51629f7d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:08.941848 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a0a08450-3fcb-42d6-ae79-589a51629f7d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:08.970598 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c56907e6-6134-4a0a-a6ac-cbecef142861 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:08.972170 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c56907e6-6134-4a0a-a6ac-cbecef142861 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:08.984406 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c56907e6-6134-4a0a-a6ac-cbecef142861 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:08.985264 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c56907e6-6134-4a0a-a6ac-cbecef142861 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:08.986160 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c56907e6-6134-4a0a-a6ac-cbecef142861 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:08.986736 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c56907e6-6134-4a0a-a6ac-cbecef142861 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:09.042805 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a0a08450-3fcb-42d6-ae79-589a51629f7d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 28635 microversion: 2.20 time: 0.118309 Jan 05 15:01:09.047258 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 133/273] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:08 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 28635 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:01:09.117171 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c56907e6-6134-4a0a-a6ac-cbecef142861 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 35513 microversion: 2.1 time: 0.150884 Jan 05 15:01:09.121301 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 141/274] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:01:08 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 35513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:01:09.823328 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-37696be3-b0bc-438d-a622-068c287ba76a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:09.824373 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-37696be3-b0bc-438d-a622-068c287ba76a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:09.831589 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-37696be3-b0bc-438d-a622-068c287ba76a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:09.832037 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-37696be3-b0bc-438d-a622-068c287ba76a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:09.832813 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-37696be3-b0bc-438d-a622-068c287ba76a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:09.833279 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-37696be3-b0bc-438d-a622-068c287ba76a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:09.873776 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-37696be3-b0bc-438d-a622-068c287ba76a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lazy-loading 'flavor' on Instance uuid 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:01:10.057390 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c049cb78-cb13-4f4d-9670-4b6e887e2d04 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:10.058389 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c049cb78-cb13-4f4d-9670-4b6e887e2d04 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:10.065905 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c049cb78-cb13-4f4d-9670-4b6e887e2d04 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:10.066343 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c049cb78-cb13-4f4d-9670-4b6e887e2d04 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:10.067116 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c049cb78-cb13-4f4d-9670-4b6e887e2d04 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:10.067540 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c049cb78-cb13-4f4d-9670-4b6e887e2d04 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:10.207500 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-37696be3-b0bc-438d-a622-068c287ba76a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "POST /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/action" status: 200 len: 32 microversion: 2.1 time: 0.388384 Jan 05 15:01:10.208104 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 134/275] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:01:09 2022] POST /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/action => generated 32 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:01:10.213558 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-8d8284ab-4573-4902-8026-a71356ca6ac2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:10.214552 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-8d8284ab-4573-4902-8026-a71356ca6ac2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:10.221400 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8d8284ab-4573-4902-8026-a71356ca6ac2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:10.221942 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8d8284ab-4573-4902-8026-a71356ca6ac2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:10.222742 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8d8284ab-4573-4902-8026-a71356ca6ac2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:10.223181 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8d8284ab-4573-4902-8026-a71356ca6ac2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:12.860512 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c049cb78-cb13-4f4d-9670-4b6e887e2d04 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 28635 microversion: 2.20 time: 2.807167 Jan 05 15:01:12.861193 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 142/276] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:10 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 28635 bytes in 2809 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:01:12.865926 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2dd099ce-0c63-4e42-9c09-8792514d4dc0 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:12.866647 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2dd099ce-0c63-4e42-9c09-8792514d4dc0 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:12.874133 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dd099ce-0c63-4e42-9c09-8792514d4dc0 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:12.874593 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dd099ce-0c63-4e42-9c09-8792514d4dc0 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:12.875384 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dd099ce-0c63-4e42-9c09-8792514d4dc0 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:12.875819 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dd099ce-0c63-4e42-9c09-8792514d4dc0 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:12.937541 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-8d8284ab-4573-4902-8026-a71356ca6ac2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 38096 microversion: 2.1 time: 2.726964 Jan 05 15:01:12.938820 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 135/277] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:01:10 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 38096 bytes in 2730 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:01:13.009896 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-2dd099ce-0c63-4e42-9c09-8792514d4dc0 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:13.018858 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2dd099ce-0c63-4e42-9c09-8792514d4dc0 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1521 microversion: 2.1 time: 0.156233 Jan 05 15:01:13.019840 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 143/278] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:12 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:13.872495 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3e66120d-561a-45d7-9ac2-7eab42458dd0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:13.876537 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3e66120d-561a-45d7-9ac2-7eab42458dd0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:13.881177 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3e66120d-561a-45d7-9ac2-7eab42458dd0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:13.881623 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3e66120d-561a-45d7-9ac2-7eab42458dd0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:13.882728 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3e66120d-561a-45d7-9ac2-7eab42458dd0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:13.883159 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3e66120d-561a-45d7-9ac2-7eab42458dd0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:13.911456 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-594041853", "imageRef": "e4c11159-1e41-437a-af97-eb5f10704ae6", "flavorRef": "452", "networks": [{"uuid": "aec55d3c-7bde-4a3f-bf24-eddde8e56c38"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:13.978235 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] validate_networks() for [('aec55d3c-7bde-4a3f-bf24-eddde8e56c38', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 15:01:13.999403 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3e66120d-561a-45d7-9ac2-7eab42458dd0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 29245 microversion: 2.20 time: 0.129871 Jan 05 15:01:14.000614 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 136/279] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:13 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 29245 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:01:14.013730 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ce70d1f7-ae55-4cd6-9561-09ec79471d56 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:14.015412 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ce70d1f7-ae55-4cd6-9561-09ec79471d56 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:14.022830 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ce70d1f7-ae55-4cd6-9561-09ec79471d56 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:14.023481 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ce70d1f7-ae55-4cd6-9561-09ec79471d56 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:14.024429 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ce70d1f7-ae55-4cd6-9561-09ec79471d56 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:14.025649 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ce70d1f7-ae55-4cd6-9561-09ec79471d56 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:14.140260 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ce70d1f7-ae55-4cd6-9561-09ec79471d56 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 38164 microversion: 2.1 time: 0.137198 Jan 05 15:01:14.141017 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 137/280] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:01:14 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 38164 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:01:14.146168 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-68ea2aaf-1557-415f-a55a-e1d107feb2f2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:14.146761 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-68ea2aaf-1557-415f-a55a-e1d107feb2f2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:14.153684 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-68ea2aaf-1557-415f-a55a-e1d107feb2f2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:14.154131 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-68ea2aaf-1557-415f-a55a-e1d107feb2f2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:14.154968 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-68ea2aaf-1557-415f-a55a-e1d107feb2f2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:14.155383 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-68ea2aaf-1557-415f-a55a-e1d107feb2f2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:14.297246 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-68ea2aaf-1557-415f-a55a-e1d107feb2f2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:14.305309 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-68ea2aaf-1557-415f-a55a-e1d107feb2f2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1521 microversion: 2.1 time: 0.162884 Jan 05 15:01:14.306484 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 138/281] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:14 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:14.350464 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 15:01:14.350891 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 15:01:14.351359 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 15:01:14.351795 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 15:01:14.352204 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 15:01:14.361339 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:14.370069 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:14.370069 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:14.370069 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:14.380294 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Getting quotas for project e785ec07120a4184acdbf74f73489ce8. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:01:14.384224 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Getting quotas for user 0669d8dce2d64715948615519bf0eac9 and project e785ec07120a4184acdbf74f73489ce8. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:01:14.395672 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 15:01:14.398016 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4c11159-1e41-437a-af97-eb5f10704ae6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 15:01:14.515459 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607654 Jan 05 15:01:14.516182 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 144/282] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 15:01:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 05 15:01:14.531832 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e47f9ad0-9cc7-41dd-bd15-959dd770f069 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:14.532490 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e47f9ad0-9cc7-41dd-bd15-959dd770f069 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:14.590406 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e47f9ad0-9cc7-41dd-bd15-959dd770f069 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:14.600297 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e47f9ad0-9cc7-41dd-bd15-959dd770f069 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 200 len: 1213 microversion: 2.1 time: 0.077766 Jan 05 15:01:14.600899 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 139/283] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:14 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:15.015622 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63124c49-c295-4403-9a22-b793da421306 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:15.017357 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-63124c49-c295-4403-9a22-b793da421306 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:15.024495 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63124c49-c295-4403-9a22-b793da421306 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:15.024936 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63124c49-c295-4403-9a22-b793da421306 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:15.026280 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63124c49-c295-4403-9a22-b793da421306 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:15.026731 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63124c49-c295-4403-9a22-b793da421306 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:15.143260 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-63124c49-c295-4403-9a22-b793da421306 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 32579 microversion: 2.20 time: 0.134792 Jan 05 15:01:15.148941 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 145/284] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:15 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 32579 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:01:15.151702 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c61d2467-e239-4d6e-bc32-c8777bd83e7f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:15.152785 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c61d2467-e239-4d6e-bc32-c8777bd83e7f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:15.160900 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c61d2467-e239-4d6e-bc32-c8777bd83e7f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:15.161370 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c61d2467-e239-4d6e-bc32-c8777bd83e7f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:15.163100 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c61d2467-e239-4d6e-bc32-c8777bd83e7f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:15.163687 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c61d2467-e239-4d6e-bc32-c8777bd83e7f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:15.258772 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c61d2467-e239-4d6e-bc32-c8777bd83e7f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 38164 microversion: 2.1 time: 0.110559 Jan 05 15:01:15.259676 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 140/285] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:01:15 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 38164 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:01:15.323317 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-48385da3-ccc8-4a1b-90b0-c6fc191eccd4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:15.324015 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-48385da3-ccc8-4a1b-90b0-c6fc191eccd4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:15.331794 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48385da3-ccc8-4a1b-90b0-c6fc191eccd4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:15.332244 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48385da3-ccc8-4a1b-90b0-c6fc191eccd4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:15.333032 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48385da3-ccc8-4a1b-90b0-c6fc191eccd4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:15.333707 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48385da3-ccc8-4a1b-90b0-c6fc191eccd4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:15.479232 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-48385da3-ccc8-4a1b-90b0-c6fc191eccd4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:15.487014 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-48385da3-ccc8-4a1b-90b0-c6fc191eccd4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1521 microversion: 2.1 time: 0.167658 Jan 05 15:01:15.487588 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 146/286] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:15 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:15.618558 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1378de1d-8544-4d24-915a-742380bf1bd1 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:15.619260 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1378de1d-8544-4d24-915a-742380bf1bd1 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:15.671899 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-1378de1d-8544-4d24-915a-742380bf1bd1 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:15.678447 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1378de1d-8544-4d24-915a-742380bf1bd1 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 200 len: 1213 microversion: 2.1 time: 0.064009 Jan 05 15:01:15.678996 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 141/287] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:15 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:16.154946 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c2c63928-60d0-44ab-96b2-95a4eb4cd8aa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:16.155859 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c2c63928-60d0-44ab-96b2-95a4eb4cd8aa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:16.162097 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2c63928-60d0-44ab-96b2-95a4eb4cd8aa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:16.162527 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2c63928-60d0-44ab-96b2-95a4eb4cd8aa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:16.163293 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2c63928-60d0-44ab-96b2-95a4eb4cd8aa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:16.163717 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2c63928-60d0-44ab-96b2-95a4eb4cd8aa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:16.264605 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c2c63928-60d0-44ab-96b2-95a4eb4cd8aa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 33694 microversion: 2.20 time: 0.113128 Jan 05 15:01:16.265530 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 147/288] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:16 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 33694 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:01:16.269766 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3a8468ae-783d-435b-8b9a-a52d12c69344 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:16.270676 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3a8468ae-783d-435b-8b9a-a52d12c69344 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:16.277384 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3a8468ae-783d-435b-8b9a-a52d12c69344 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:16.277815 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3a8468ae-783d-435b-8b9a-a52d12c69344 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:16.278607 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3a8468ae-783d-435b-8b9a-a52d12c69344 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:16.279106 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3a8468ae-783d-435b-8b9a-a52d12c69344 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:16.376094 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3a8468ae-783d-435b-8b9a-a52d12c69344 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 38164 microversion: 2.1 time: 0.109958 Jan 05 15:01:16.376746 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 142/289] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:01:16 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 38164 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:01:16.504123 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-31726154-b19d-44e6-b4d6-0038d6ec0221 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:16.504812 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-31726154-b19d-44e6-b4d6-0038d6ec0221 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:16.511616 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31726154-b19d-44e6-b4d6-0038d6ec0221 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:16.512177 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31726154-b19d-44e6-b4d6-0038d6ec0221 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:16.518710 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31726154-b19d-44e6-b4d6-0038d6ec0221 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:16.518710 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31726154-b19d-44e6-b4d6-0038d6ec0221 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:16.655387 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-31726154-b19d-44e6-b4d6-0038d6ec0221 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:16.662877 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-31726154-b19d-44e6-b4d6-0038d6ec0221 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1521 microversion: 2.1 time: 0.162858 Jan 05 15:01:16.663432 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 148/290] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:16 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:16.695904 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-514f4d5f-11a7-4011-8a11-3ea76a255744 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:16.696559 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-514f4d5f-11a7-4011-8a11-3ea76a255744 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:16.703265 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-514f4d5f-11a7-4011-8a11-3ea76a255744 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:16.703713 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-514f4d5f-11a7-4011-8a11-3ea76a255744 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:16.704483 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-514f4d5f-11a7-4011-8a11-3ea76a255744 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:16.704912 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-514f4d5f-11a7-4011-8a11-3ea76a255744 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:16.764986 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-514f4d5f-11a7-4011-8a11-3ea76a255744 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:16.772386 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-514f4d5f-11a7-4011-8a11-3ea76a255744 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 200 len: 1265 microversion: 2.1 time: 0.080566 Jan 05 15:01:16.772953 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 143/291] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:16 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:17.276884 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-185b6c14-76ed-48a2-870f-3e0651ca3012 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:17.277837 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-185b6c14-76ed-48a2-870f-3e0651ca3012 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:17.284659 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-185b6c14-76ed-48a2-870f-3e0651ca3012 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:17.285137 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-185b6c14-76ed-48a2-870f-3e0651ca3012 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:17.285965 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-185b6c14-76ed-48a2-870f-3e0651ca3012 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:17.286462 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-185b6c14-76ed-48a2-870f-3e0651ca3012 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:17.388290 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b7c05ce9-1a2f-4396-b35c-ede1ae93d3b3 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:17.389879 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b7c05ce9-1a2f-4396-b35c-ede1ae93d3b3 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:17.391465 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-185b6c14-76ed-48a2-870f-3e0651ca3012 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 34409 microversion: 2.20 time: 0.118189 Jan 05 15:01:17.392791 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 149/292] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:17 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 34409 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:01:17.396257 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b7c05ce9-1a2f-4396-b35c-ede1ae93d3b3 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:17.396701 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b7c05ce9-1a2f-4396-b35c-ede1ae93d3b3 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:17.397518 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b7c05ce9-1a2f-4396-b35c-ede1ae93d3b3 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:17.397976 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b7c05ce9-1a2f-4396-b35c-ede1ae93d3b3 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:17.521598 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b7c05ce9-1a2f-4396-b35c-ede1ae93d3b3 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 200 len: 38295 microversion: 2.1 time: 0.131498 Jan 05 15:01:17.521598 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 144/293] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:01:17 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 38295 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:01:17.527109 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4cec0aca-e08e-4dc0-ae3b-dcca51fbd8a6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:17.527684 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4cec0aca-e08e-4dc0-ae3b-dcca51fbd8a6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:17.535720 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cec0aca-e08e-4dc0-ae3b-dcca51fbd8a6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:17.536171 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cec0aca-e08e-4dc0-ae3b-dcca51fbd8a6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:17.537244 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cec0aca-e08e-4dc0-ae3b-dcca51fbd8a6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:17.537982 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cec0aca-e08e-4dc0-ae3b-dcca51fbd8a6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:17.573541 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4cec0aca-e08e-4dc0-ae3b-dcca51fbd8a6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/ips" status: 200 len: 144 microversion: 2.1 time: 0.050374 Jan 05 15:01:17.574203 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 150/294] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Jan 5 15:01:17 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/ips => generated 144 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:01:17.680224 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ac7eecb5-6aa9-4062-8ff7-90d3a40bb38e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:17.680920 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ac7eecb5-6aa9-4062-8ff7-90d3a40bb38e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:17.690702 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ac7eecb5-6aa9-4062-8ff7-90d3a40bb38e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:17.691151 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ac7eecb5-6aa9-4062-8ff7-90d3a40bb38e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:17.691993 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ac7eecb5-6aa9-4062-8ff7-90d3a40bb38e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:17.692467 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ac7eecb5-6aa9-4062-8ff7-90d3a40bb38e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:17.794337 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2eda2eac-6a60-4296-8dd7-db8267a8c97f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:17.795033 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2eda2eac-6a60-4296-8dd7-db8267a8c97f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:17.802801 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eda2eac-6a60-4296-8dd7-db8267a8c97f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:17.803580 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eda2eac-6a60-4296-8dd7-db8267a8c97f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:17.804638 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eda2eac-6a60-4296-8dd7-db8267a8c97f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:17.805313 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eda2eac-6a60-4296-8dd7-db8267a8c97f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:17.864116 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ac7eecb5-6aa9-4062-8ff7-90d3a40bb38e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:17.873161 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ac7eecb5-6aa9-4062-8ff7-90d3a40bb38e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1521 microversion: 2.1 time: 0.196912 Jan 05 15:01:17.879149 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 145/295] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:17 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:17.883790 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-2eda2eac-6a60-4296-8dd7-db8267a8c97f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:17.894011 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2eda2eac-6a60-4296-8dd7-db8267a8c97f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 200 len: 1273 microversion: 2.1 time: 0.103276 Jan 05 15:01:17.894863 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 151/296] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:17 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:18.405040 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-265cca62-d7b2-466b-93da-1c0555f83450 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:18.406641 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-265cca62-d7b2-466b-93da-1c0555f83450 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:18.413459 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-265cca62-d7b2-466b-93da-1c0555f83450 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:18.413939 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-265cca62-d7b2-466b-93da-1c0555f83450 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:18.415053 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-265cca62-d7b2-466b-93da-1c0555f83450 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:18.415581 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-265cca62-d7b2-466b-93da-1c0555f83450 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:18.550455 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-265cca62-d7b2-466b-93da-1c0555f83450 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 35046 microversion: 2.20 time: 0.150232 Jan 05 15:01:18.554753 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 146/297] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:18 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 35046 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:01:18.895787 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5aa99e63-98d9-47c5-9085-4835075be706 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:18.897089 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5aa99e63-98d9-47c5-9085-4835075be706 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:18.907793 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5aa99e63-98d9-47c5-9085-4835075be706 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:18.908730 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5aa99e63-98d9-47c5-9085-4835075be706 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:18.910142 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5aa99e63-98d9-47c5-9085-4835075be706 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:18.911080 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5aa99e63-98d9-47c5-9085-4835075be706 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:18.919261 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-0aaa478d-e388-41a7-be44-2b0b099a5dd5 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:18.920048 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0aaa478d-e388-41a7-be44-2b0b099a5dd5 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:18.927340 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0aaa478d-e388-41a7-be44-2b0b099a5dd5 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:18.927788 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0aaa478d-e388-41a7-be44-2b0b099a5dd5 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:18.929716 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0aaa478d-e388-41a7-be44-2b0b099a5dd5 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:18.929716 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0aaa478d-e388-41a7-be44-2b0b099a5dd5 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:19.082220 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-5aa99e63-98d9-47c5-9085-4835075be706 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:19.091050 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5aa99e63-98d9-47c5-9085-4835075be706 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1521 microversion: 2.1 time: 0.199528 Jan 05 15:01:19.092511 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 152/298] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:18 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:19.102694 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-0aaa478d-e388-41a7-be44-2b0b099a5dd5 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:19.115121 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-0aaa478d-e388-41a7-be44-2b0b099a5dd5 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 200 len: 1313 microversion: 2.1 time: 0.199455 Jan 05 15:01:19.115121 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 147/299] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:18 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:19.440285 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-67c5aebe-683b-452a-82be-2887d9deebd5 req-d6072b99-d902-4b45-bade-c8f63104493d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c747ca1-458e-4b0c-aa5f-fa911f90280e", "tag": "1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:19.442397 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:01:19.442397 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:01:19.453590 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-67c5aebe-683b-452a-82be-2887d9deebd5 req-d6072b99-d902-4b45-bade-c8f63104493d service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:19.454385 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-67c5aebe-683b-452a-82be-2887d9deebd5 req-d6072b99-d902-4b45-bade-c8f63104493d service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:19.481788 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-67c5aebe-683b-452a-82be-2887d9deebd5 req-d6072b99-d902-4b45-bade-c8f63104493d service nova] Creating event network-changed:1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 for instance 4c747ca1-458e-4b0c-aa5f-fa911f90280e on hv-cinder-maste Jan 05 15:01:19.497736 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-67c5aebe-683b-452a-82be-2887d9deebd5 req-d6072b99-d902-4b45-bade-c8f63104493d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063224 Jan 05 15:01:19.498551 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 153/300] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:01:19.564111 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-9ffc7c85-fc24-4cb2-ba54-7de1263c44a7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:19.566471 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-9ffc7c85-fc24-4cb2-ba54-7de1263c44a7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:19.573694 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9ffc7c85-fc24-4cb2-ba54-7de1263c44a7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:19.574358 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9ffc7c85-fc24-4cb2-ba54-7de1263c44a7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:19.575878 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9ffc7c85-fc24-4cb2-ba54-7de1263c44a7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:19.576465 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9ffc7c85-fc24-4cb2-ba54-7de1263c44a7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:19.694946 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-9ffc7c85-fc24-4cb2-ba54-7de1263c44a7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 36080 microversion: 2.20 time: 0.135409 Jan 05 15:01:19.695604 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 148/301] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:19 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 36080 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:01:20.110348 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ac3115c1-1f40-405a-bfa0-d7e19c04aa11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:20.114525 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ac3115c1-1f40-405a-bfa0-d7e19c04aa11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:20.117825 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac3115c1-1f40-405a-bfa0-d7e19c04aa11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:20.118279 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac3115c1-1f40-405a-bfa0-d7e19c04aa11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:20.119649 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac3115c1-1f40-405a-bfa0-d7e19c04aa11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:20.120104 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac3115c1-1f40-405a-bfa0-d7e19c04aa11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:20.130625 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-da79d71d-989c-4453-a040-37dbcd3f75c4 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:20.131323 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-da79d71d-989c-4453-a040-37dbcd3f75c4 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:20.142404 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-da79d71d-989c-4453-a040-37dbcd3f75c4 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:20.142852 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-da79d71d-989c-4453-a040-37dbcd3f75c4 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:20.143710 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-da79d71d-989c-4453-a040-37dbcd3f75c4 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:20.147924 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-da79d71d-989c-4453-a040-37dbcd3f75c4 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:20.301199 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-da79d71d-989c-4453-a040-37dbcd3f75c4 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:20.310163 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-da79d71d-989c-4453-a040-37dbcd3f75c4 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 200 len: 1313 microversion: 2.1 time: 0.183528 Jan 05 15:01:20.312688 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 149/302] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:20 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:20.591450 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-ac3115c1-1f40-405a-bfa0-d7e19c04aa11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:20.602111 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ac3115c1-1f40-405a-bfa0-d7e19c04aa11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1521 microversion: 2.1 time: 0.497759 Jan 05 15:01:20.602942 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 154/303] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:20 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:20.620188 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-508dc83a-fc7c-4fef-9e68-41d463aee536 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d61088ea-b133-4a09-b64f-263589bd3a31"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:20.621566 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-508dc83a-fc7c-4fef-9e68-41d463aee536 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:20.628001 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-508dc83a-fc7c-4fef-9e68-41d463aee536 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:20.628460 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-508dc83a-fc7c-4fef-9e68-41d463aee536 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:20.629323 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-508dc83a-fc7c-4fef-9e68-41d463aee536 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:20.629765 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-508dc83a-fc7c-4fef-9e68-41d463aee536 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:20.707425 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86c70c5e-89f6-4502-a40a-498b9320620f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:20.708336 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-86c70c5e-89f6-4502-a40a-498b9320620f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:20.714213 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86c70c5e-89f6-4502-a40a-498b9320620f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:20.714660 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86c70c5e-89f6-4502-a40a-498b9320620f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:20.715480 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86c70c5e-89f6-4502-a40a-498b9320620f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:20.715913 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86c70c5e-89f6-4502-a40a-498b9320620f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:20.866128 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-86c70c5e-89f6-4502-a40a-498b9320620f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 37105 microversion: 2.20 time: 0.162193 Jan 05 15:01:20.869646 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 155/304] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:20 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 37105 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:01:21.328574 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-17a842db-72ff-470f-9d2d-339d049eed10 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:21.329435 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-17a842db-72ff-470f-9d2d-339d049eed10 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:21.336437 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17a842db-72ff-470f-9d2d-339d049eed10 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:21.337090 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17a842db-72ff-470f-9d2d-339d049eed10 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:21.338085 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17a842db-72ff-470f-9d2d-339d049eed10 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:21.338511 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17a842db-72ff-470f-9d2d-339d049eed10 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:21.487530 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-17a842db-72ff-470f-9d2d-339d049eed10 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:21.495003 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-17a842db-72ff-470f-9d2d-339d049eed10 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 200 len: 1313 microversion: 2.1 time: 0.170782 Jan 05 15:01:21.497711 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 156/305] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:21 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:21.618999 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e1bc48ed-e8e5-45c5-b123-cc5a50cf2cad tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:21.619627 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e1bc48ed-e8e5-45c5-b123-cc5a50cf2cad tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:21.625815 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1bc48ed-e8e5-45c5-b123-cc5a50cf2cad tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:21.626256 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1bc48ed-e8e5-45c5-b123-cc5a50cf2cad tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:21.627023 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1bc48ed-e8e5-45c5-b123-cc5a50cf2cad tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:21.627447 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1bc48ed-e8e5-45c5-b123-cc5a50cf2cad tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:21.681755 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-508dc83a-fc7c-4fef-9e68-41d463aee536 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.065117 Jan 05 15:01:21.684372 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 150/306] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Jan 5 15:01:20 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/os-volume_attachments => generated 194 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:01:21.771539 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e1bc48ed-e8e5-45c5-b123-cc5a50cf2cad tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:21.778854 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e1bc48ed-e8e5-45c5-b123-cc5a50cf2cad tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1521 microversion: 2.1 time: 0.163564 Jan 05 15:01:21.779430 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 157/307] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:21 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:21.878841 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e80e3aa4-4e59-4ed2-987a-d85cbb6557a7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:21.880221 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e80e3aa4-4e59-4ed2-987a-d85cbb6557a7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:21.888293 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e80e3aa4-4e59-4ed2-987a-d85cbb6557a7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:21.889763 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e80e3aa4-4e59-4ed2-987a-d85cbb6557a7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:21.891380 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e80e3aa4-4e59-4ed2-987a-d85cbb6557a7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:21.893808 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e80e3aa4-4e59-4ed2-987a-d85cbb6557a7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:22.002854 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e80e3aa4-4e59-4ed2-987a-d85cbb6557a7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 38183 microversion: 2.20 time: 0.128236 Jan 05 15:01:22.005097 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 151/308] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:21 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 38183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:01:22.512319 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ce1027eb-7011-47e5-819e-16b52064f07f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:22.513570 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ce1027eb-7011-47e5-819e-16b52064f07f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:22.521462 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce1027eb-7011-47e5-819e-16b52064f07f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:22.521904 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce1027eb-7011-47e5-819e-16b52064f07f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:22.522822 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce1027eb-7011-47e5-819e-16b52064f07f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:22.523247 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce1027eb-7011-47e5-819e-16b52064f07f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:22.658056 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-ce1027eb-7011-47e5-819e-16b52064f07f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:22.665990 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ce1027eb-7011-47e5-819e-16b52064f07f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 200 len: 1313 microversion: 2.1 time: 0.157753 Jan 05 15:01:22.666612 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 158/309] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:22 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:22.800027 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2e80ecf9-08ee-46a5-8a87-bc539967b986 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:22.801749 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2e80ecf9-08ee-46a5-8a87-bc539967b986 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:22.808594 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2e80ecf9-08ee-46a5-8a87-bc539967b986 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:22.809044 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2e80ecf9-08ee-46a5-8a87-bc539967b986 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:22.812160 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2e80ecf9-08ee-46a5-8a87-bc539967b986 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:22.812160 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2e80ecf9-08ee-46a5-8a87-bc539967b986 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:22.953560 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-2e80ecf9-08ee-46a5-8a87-bc539967b986 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:22.964007 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2e80ecf9-08ee-46a5-8a87-bc539967b986 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1521 microversion: 2.1 time: 0.169088 Jan 05 15:01:22.964658 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 152/310] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:22 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:23.014766 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95e83cfd-b8e4-4f68-b15a-d85bad756f32 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:23.015707 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-95e83cfd-b8e4-4f68-b15a-d85bad756f32 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:23.024005 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95e83cfd-b8e4-4f68-b15a-d85bad756f32 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:23.024850 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95e83cfd-b8e4-4f68-b15a-d85bad756f32 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:23.026178 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95e83cfd-b8e4-4f68-b15a-d85bad756f32 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:23.026691 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95e83cfd-b8e4-4f68-b15a-d85bad756f32 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:23.118115 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-95e83cfd-b8e4-4f68-b15a-d85bad756f32 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 38183 microversion: 2.20 time: 0.106927 Jan 05 15:01:23.123164 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 159/311] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:23 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 38183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:01:23.682632 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e4b249d3-e939-4426-bb90-a1b1f68b3095 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:23.683267 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e4b249d3-e939-4426-bb90-a1b1f68b3095 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:23.690068 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e4b249d3-e939-4426-bb90-a1b1f68b3095 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:23.690514 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e4b249d3-e939-4426-bb90-a1b1f68b3095 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:23.691286 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e4b249d3-e939-4426-bb90-a1b1f68b3095 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:23.691746 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e4b249d3-e939-4426-bb90-a1b1f68b3095 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:23.861396 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e4b249d3-e939-4426-bb90-a1b1f68b3095 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:23.872081 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e4b249d3-e939-4426-bb90-a1b1f68b3095 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 200 len: 1313 microversion: 2.1 time: 0.192945 Jan 05 15:01:23.872661 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 153/312] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:23 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:23.981848 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e668432d-ed6e-49eb-a849-9e6f142d7e34 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:23.982968 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e668432d-ed6e-49eb-a849-9e6f142d7e34 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:23.990458 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e668432d-ed6e-49eb-a849-9e6f142d7e34 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:23.990976 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e668432d-ed6e-49eb-a849-9e6f142d7e34 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:23.991837 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e668432d-ed6e-49eb-a849-9e6f142d7e34 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:23.992454 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e668432d-ed6e-49eb-a849-9e6f142d7e34 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:24.130522 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e5321a39-0f3a-4f83-a92c-486982fbe8cc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:24.132114 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e5321a39-0f3a-4f83-a92c-486982fbe8cc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:24.137734 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e668432d-ed6e-49eb-a849-9e6f142d7e34 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:24.140849 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e5321a39-0f3a-4f83-a92c-486982fbe8cc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:24.140849 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e5321a39-0f3a-4f83-a92c-486982fbe8cc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:24.140849 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e5321a39-0f3a-4f83-a92c-486982fbe8cc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:24.141124 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e5321a39-0f3a-4f83-a92c-486982fbe8cc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:24.149783 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e668432d-ed6e-49eb-a849-9e6f142d7e34 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1521 microversion: 2.1 time: 0.172166 Jan 05 15:01:24.150441 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 160/313] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:23 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:24.229887 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e5321a39-0f3a-4f83-a92c-486982fbe8cc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 38183 microversion: 2.20 time: 0.102544 Jan 05 15:01:24.231230 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 154/314] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:24 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 38183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:01:24.888213 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7de1c303-1ee5-468a-9eea-de660ffac3df tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:24.888846 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7de1c303-1ee5-468a-9eea-de660ffac3df tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:24.897017 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7de1c303-1ee5-468a-9eea-de660ffac3df tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:24.897873 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7de1c303-1ee5-468a-9eea-de660ffac3df tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:24.899163 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7de1c303-1ee5-468a-9eea-de660ffac3df tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:24.899804 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7de1c303-1ee5-468a-9eea-de660ffac3df tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:25.065489 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-7de1c303-1ee5-468a-9eea-de660ffac3df tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:25.072746 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7de1c303-1ee5-468a-9eea-de660ffac3df tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 200 len: 1313 microversion: 2.1 time: 0.188569 Jan 05 15:01:25.073455 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 161/315] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:24 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:25.167568 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-9ab16e05-3c93-4e6f-8363-85858137e985 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:25.168301 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-9ab16e05-3c93-4e6f-8363-85858137e985 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:25.175570 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9ab16e05-3c93-4e6f-8363-85858137e985 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:25.176005 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9ab16e05-3c93-4e6f-8363-85858137e985 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:25.176813 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9ab16e05-3c93-4e6f-8363-85858137e985 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:25.177284 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9ab16e05-3c93-4e6f-8363-85858137e985 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:25.241929 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c0f3deeb-46a5-4b9d-b3d2-f0c3854d8f01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:25.242839 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c0f3deeb-46a5-4b9d-b3d2-f0c3854d8f01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:25.250115 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0f3deeb-46a5-4b9d-b3d2-f0c3854d8f01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:25.250560 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0f3deeb-46a5-4b9d-b3d2-f0c3854d8f01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:25.251371 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0f3deeb-46a5-4b9d-b3d2-f0c3854d8f01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:25.251827 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0f3deeb-46a5-4b9d-b3d2-f0c3854d8f01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:25.321838 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-9ab16e05-3c93-4e6f-8363-85858137e985 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:25.331325 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-9ab16e05-3c93-4e6f-8363-85858137e985 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1521 microversion: 2.1 time: 0.165791 Jan 05 15:01:25.331325 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 155/316] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:25 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:25.433669 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c0f3deeb-46a5-4b9d-b3d2-f0c3854d8f01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 38183 microversion: 2.20 time: 0.195232 Jan 05 15:01:25.437873 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 162/317] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:25 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 38183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:01:26.030037 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-cb49dc51-24ac-47f8-9afe-57f33005e59c req-36f71992-fb0a-446c-a9d1-326849c4a36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c747ca1-458e-4b0c-aa5f-fa911f90280e", "name": "network-vif-plugged", "status": "completed", "tag": "1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:26.031891 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:01:26.031891 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:01:26.053379 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-cb49dc51-24ac-47f8-9afe-57f33005e59c req-36f71992-fb0a-446c-a9d1-326849c4a36d service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:26.053979 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-cb49dc51-24ac-47f8-9afe-57f33005e59c req-36f71992-fb0a-446c-a9d1-326849c4a36d service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:26.074990 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-cb49dc51-24ac-47f8-9afe-57f33005e59c req-36f71992-fb0a-446c-a9d1-326849c4a36d service nova] Creating event network-vif-plugged:1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 for instance 4c747ca1-458e-4b0c-aa5f-fa911f90280e on hv-cinder-maste Jan 05 15:01:26.080834 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-cb49dc51-24ac-47f8-9afe-57f33005e59c req-36f71992-fb0a-446c-a9d1-326849c4a36d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054309 Jan 05 15:01:26.081909 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 156/318] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:01:26.090138 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa91ce4c-1775-42a8-bc0c-6907cadf0a09 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:26.093900 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa91ce4c-1775-42a8-bc0c-6907cadf0a09 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:26.098564 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa91ce4c-1775-42a8-bc0c-6907cadf0a09 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:26.099097 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa91ce4c-1775-42a8-bc0c-6907cadf0a09 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:26.100069 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa91ce4c-1775-42a8-bc0c-6907cadf0a09 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:26.100522 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa91ce4c-1775-42a8-bc0c-6907cadf0a09 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:26.299823 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-aa91ce4c-1775-42a8-bc0c-6907cadf0a09 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:26.308749 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aa91ce4c-1775-42a8-bc0c-6907cadf0a09 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 200 len: 1313 microversion: 2.1 time: 0.222883 Jan 05 15:01:26.309601 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 163/319] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:26 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:26.346185 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2f2f3a8c-247b-4690-a66f-91ea31107903 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:26.346923 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2f2f3a8c-247b-4690-a66f-91ea31107903 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:26.353311 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2f2f3a8c-247b-4690-a66f-91ea31107903 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:26.353757 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2f2f3a8c-247b-4690-a66f-91ea31107903 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:26.354521 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2f2f3a8c-247b-4690-a66f-91ea31107903 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:26.355207 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2f2f3a8c-247b-4690-a66f-91ea31107903 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:26.447889 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-741ae846-5c35-4154-8b3d-fba880f27e08 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:26.448904 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-741ae846-5c35-4154-8b3d-fba880f27e08 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:26.455973 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-741ae846-5c35-4154-8b3d-fba880f27e08 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:26.456742 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-741ae846-5c35-4154-8b3d-fba880f27e08 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:26.458110 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-741ae846-5c35-4154-8b3d-fba880f27e08 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:26.458741 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-741ae846-5c35-4154-8b3d-fba880f27e08 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:26.568251 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-2f2f3a8c-247b-4690-a66f-91ea31107903 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:26.576066 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2f2f3a8c-247b-4690-a66f-91ea31107903 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1521 microversion: 2.1 time: 0.233844 Jan 05 15:01:26.576664 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 157/320] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:26 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:26.607116 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-741ae846-5c35-4154-8b3d-fba880f27e08 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 200 len: 38325 microversion: 2.20 time: 0.165040 Jan 05 15:01:26.608312 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 164/321] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:26 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 38325 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:01:26.618421 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-59f94385-e587-40c5-859f-2563eef3361e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:26.618862 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-59f94385-e587-40c5-859f-2563eef3361e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:26.625574 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-59f94385-e587-40c5-859f-2563eef3361e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:26.625809 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-59f94385-e587-40c5-859f-2563eef3361e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:26.626578 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-59f94385-e587-40c5-859f-2563eef3361e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:26.627009 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-59f94385-e587-40c5-859f-2563eef3361e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:26.657030 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-59f94385-e587-40c5-859f-2563eef3361e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/ips" status: 200 len: 153 microversion: 2.20 time: 0.042634 Jan 05 15:01:26.658189 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 158/322] 10.222.0.30 () {60 vars in 1288 bytes} [Wed Jan 5 15:01:26 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/ips => generated 153 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:01:27.327355 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c5b6e683-d400-4ee5-8088-180a09b69c64 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:27.328081 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c5b6e683-d400-4ee5-8088-180a09b69c64 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:27.335230 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5b6e683-d400-4ee5-8088-180a09b69c64 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:27.335678 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5b6e683-d400-4ee5-8088-180a09b69c64 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:27.336457 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5b6e683-d400-4ee5-8088-180a09b69c64 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:27.336888 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5b6e683-d400-4ee5-8088-180a09b69c64 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:27.485771 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-c5b6e683-d400-4ee5-8088-180a09b69c64 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:27.494697 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c5b6e683-d400-4ee5-8088-180a09b69c64 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 200 len: 1313 microversion: 2.1 time: 0.171811 Jan 05 15:01:27.500124 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 165/323] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:27 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:27.600596 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-bca5b1c9-7ddd-42ae-8581-2c5d5321f2e3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:27.600596 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-bca5b1c9-7ddd-42ae-8581-2c5d5321f2e3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:27.600596 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bca5b1c9-7ddd-42ae-8581-2c5d5321f2e3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:27.600596 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bca5b1c9-7ddd-42ae-8581-2c5d5321f2e3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:27.601261 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bca5b1c9-7ddd-42ae-8581-2c5d5321f2e3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:27.601446 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bca5b1c9-7ddd-42ae-8581-2c5d5321f2e3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:27.733186 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-bca5b1c9-7ddd-42ae-8581-2c5d5321f2e3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:27.740642 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-bca5b1c9-7ddd-42ae-8581-2c5d5321f2e3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1501 microversion: 2.1 time: 0.151478 Jan 05 15:01:27.752395 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 159/324] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:27 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:27.757333 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d0bf5b6b-2f30-409f-a875-342618f2ad6d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0446293-a2bd-4777-b47b-2434452bead6"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:27.758393 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d0bf5b6b-2f30-409f-a875-342618f2ad6d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:27.765610 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0bf5b6b-2f30-409f-a875-342618f2ad6d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:27.766053 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0bf5b6b-2f30-409f-a875-342618f2ad6d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:27.766837 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0bf5b6b-2f30-409f-a875-342618f2ad6d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:27.767267 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0bf5b6b-2f30-409f-a875-342618f2ad6d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:27.794488 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-d0bf5b6b-2f30-409f-a875-342618f2ad6d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] HTTP exception thrown: Cannot 'attach_volume' instance 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb while it is in vm_state rescued Jan 05 15:01:27.796069 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d0bf5b6b-2f30-409f-a875-342618f2ad6d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Returning 409 to user: Cannot 'attach_volume' instance 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb while it is in vm_state rescued {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:01:27.796910 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d0bf5b6b-2f30-409f-a875-342618f2ad6d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "POST /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043566 Jan 05 15:01:27.797490 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 166/325] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Jan 5 15:01:27 2022] POST /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 05 15:01:27.805646 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-488b2642-34e1-465b-bf93-e4f7823fc6dd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:27.806532 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-488b2642-34e1-465b-bf93-e4f7823fc6dd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:27.812755 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-488b2642-34e1-465b-bf93-e4f7823fc6dd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:27.813357 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-488b2642-34e1-465b-bf93-e4f7823fc6dd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:27.814230 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-488b2642-34e1-465b-bf93-e4f7823fc6dd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:27.814732 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-488b2642-34e1-465b-bf93-e4f7823fc6dd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:28.188234 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-488b2642-34e1-465b-bf93-e4f7823fc6dd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "POST /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/action" status: 202 len: 0 microversion: 2.1 time: 0.385566 Jan 05 15:01:28.188856 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 160/326] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:01:27 2022] POST /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:01:28.197137 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e716f788-1daa-47d3-b23f-4aafe90815af tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:28.197763 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e716f788-1daa-47d3-b23f-4aafe90815af tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:28.205058 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e716f788-1daa-47d3-b23f-4aafe90815af tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:28.205537 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e716f788-1daa-47d3-b23f-4aafe90815af tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:28.209684 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e716f788-1daa-47d3-b23f-4aafe90815af tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:28.209684 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e716f788-1daa-47d3-b23f-4aafe90815af tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:28.390750 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e716f788-1daa-47d3-b23f-4aafe90815af tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:28.426890 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e716f788-1daa-47d3-b23f-4aafe90815af tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1509 microversion: 2.1 time: 0.233432 Jan 05 15:01:28.442796 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 167/327] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:28 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:28.517213 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7afde0ee-470d-47b5-b364-d1ff91942c40 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:28.517213 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7afde0ee-470d-47b5-b364-d1ff91942c40 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:28.522858 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7afde0ee-470d-47b5-b364-d1ff91942c40 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:28.523313 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7afde0ee-470d-47b5-b364-d1ff91942c40 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:28.524274 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7afde0ee-470d-47b5-b364-d1ff91942c40 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:28.524709 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7afde0ee-470d-47b5-b364-d1ff91942c40 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:28.740107 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-7afde0ee-470d-47b5-b364-d1ff91942c40 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:28.748519 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7afde0ee-470d-47b5-b364-d1ff91942c40 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 200 len: 1497 microversion: 2.1 time: 0.237046 Jan 05 15:01:28.750087 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 161/328] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:28 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 1497 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:29.443720 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3656d46c-f3b0-4181-b852-1b865a6c512b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:29.444804 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3656d46c-f3b0-4181-b852-1b865a6c512b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:29.451461 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3656d46c-f3b0-4181-b852-1b865a6c512b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:29.452727 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3656d46c-f3b0-4181-b852-1b865a6c512b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:29.454013 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3656d46c-f3b0-4181-b852-1b865a6c512b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:29.454824 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3656d46c-f3b0-4181-b852-1b865a6c512b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:29.495665 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a0d439ef-623c-4cea-9531-4027bce13c84 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:29.496949 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a0d439ef-623c-4cea-9531-4027bce13c84 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:29.508164 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a0d439ef-623c-4cea-9531-4027bce13c84 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:29.508928 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a0d439ef-623c-4cea-9531-4027bce13c84 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:29.509919 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a0d439ef-623c-4cea-9531-4027bce13c84 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:29.510700 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a0d439ef-623c-4cea-9531-4027bce13c84 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:29.539069 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-a0d439ef-623c-4cea-9531-4027bce13c84 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lazy-loading 'flavor' on Instance uuid 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:01:29.606219 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3656d46c-f3b0-4181-b852-1b865a6c512b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:29.613703 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3656d46c-f3b0-4181-b852-1b865a6c512b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1509 microversion: 2.1 time: 0.173486 Jan 05 15:01:29.614257 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 168/329] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:29 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:30.183114 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a0d439ef-623c-4cea-9531-4027bce13c84 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 202 len: 0 microversion: 2.20 time: 0.691247 Jan 05 15:01:30.185113 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 162/330] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:01:29 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:01:30.192561 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4668ef72-eb06-4708-be35-30a16b26a5d2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:30.193209 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4668ef72-eb06-4708-be35-30a16b26a5d2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:30.199351 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4668ef72-eb06-4708-be35-30a16b26a5d2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:30.199790 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4668ef72-eb06-4708-be35-30a16b26a5d2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:30.200695 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4668ef72-eb06-4708-be35-30a16b26a5d2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:30.201196 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4668ef72-eb06-4708-be35-30a16b26a5d2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:30.333294 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4668ef72-eb06-4708-be35-30a16b26a5d2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:30.341807 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4668ef72-eb06-4708-be35-30a16b26a5d2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:30.343362 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4668ef72-eb06-4708-be35-30a16b26a5d2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:30.344515 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4668ef72-eb06-4708-be35-30a16b26a5d2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.155935 Jan 05 15:01:30.345085 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 169/331] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:30 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:30.630926 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e05c8b03-c948-4736-9990-8eb24495511f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:30.631872 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e05c8b03-c948-4736-9990-8eb24495511f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:30.638038 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e05c8b03-c948-4736-9990-8eb24495511f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:30.638485 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e05c8b03-c948-4736-9990-8eb24495511f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:30.639402 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e05c8b03-c948-4736-9990-8eb24495511f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:30.639803 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e05c8b03-c948-4736-9990-8eb24495511f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:30.775640 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e05c8b03-c948-4736-9990-8eb24495511f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:30.783796 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e05c8b03-c948-4736-9990-8eb24495511f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1509 microversion: 2.1 time: 0.157451 Jan 05 15:01:30.784382 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 163/332] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:30 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:31.364184 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b61cd66a-e61d-4844-9d2e-803717f3b2f5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:31.364795 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b61cd66a-e61d-4844-9d2e-803717f3b2f5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:31.371131 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b61cd66a-e61d-4844-9d2e-803717f3b2f5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:31.371568 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b61cd66a-e61d-4844-9d2e-803717f3b2f5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:31.372496 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b61cd66a-e61d-4844-9d2e-803717f3b2f5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:31.372998 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b61cd66a-e61d-4844-9d2e-803717f3b2f5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:31.416397 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b173bb84-1388-4d42-8cdd-1fe402744fa7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:31.423753 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b173bb84-1388-4d42-8cdd-1fe402744fa7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:31.424198 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b173bb84-1388-4d42-8cdd-1fe402744fa7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:31.484236 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b173bb84-1388-4d42-8cdd-1fe402744fa7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Going to try to stop instance {{(pid=128789) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 05 15:01:31.518369 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b61cd66a-e61d-4844-9d2e-803717f3b2f5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:31.526181 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b61cd66a-e61d-4844-9d2e-803717f3b2f5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:31.527702 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b61cd66a-e61d-4844-9d2e-803717f3b2f5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:31.528842 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b61cd66a-e61d-4844-9d2e-803717f3b2f5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.168610 Jan 05 15:01:31.529432 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 170/333] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:31 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:31.714309 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b173bb84-1388-4d42-8cdd-1fe402744fa7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 202 len: 0 microversion: 2.1 time: 0.301573 Jan 05 15:01:31.714993 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 164/334] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:01:31 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:01:31.724671 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-edc39688-47dc-4c09-a85e-1b87c8cbd5c5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:31.725432 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-edc39688-47dc-4c09-a85e-1b87c8cbd5c5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:31.731622 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edc39688-47dc-4c09-a85e-1b87c8cbd5c5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:31.732193 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edc39688-47dc-4c09-a85e-1b87c8cbd5c5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:31.733155 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edc39688-47dc-4c09-a85e-1b87c8cbd5c5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:31.733659 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edc39688-47dc-4c09-a85e-1b87c8cbd5c5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:31.800445 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3f1d96df-e704-48ab-bfc8-0897e328efc3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:31.801981 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3f1d96df-e704-48ab-bfc8-0897e328efc3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:31.808746 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3f1d96df-e704-48ab-bfc8-0897e328efc3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:31.809432 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3f1d96df-e704-48ab-bfc8-0897e328efc3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:31.810564 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3f1d96df-e704-48ab-bfc8-0897e328efc3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:31.811839 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3f1d96df-e704-48ab-bfc8-0897e328efc3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:31.910707 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-edc39688-47dc-4c09-a85e-1b87c8cbd5c5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:31.920765 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-edc39688-47dc-4c09-a85e-1b87c8cbd5c5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1721 microversion: 2.1 time: 0.199711 Jan 05 15:01:31.931157 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 171/335] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:31 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:31.962217 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3f1d96df-e704-48ab-bfc8-0897e328efc3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:31.972166 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3f1d96df-e704-48ab-bfc8-0897e328efc3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1509 microversion: 2.1 time: 0.175780 Jan 05 15:01:31.972910 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 165/336] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:31 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:32.547815 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3a52894c-2948-46fa-a606-4fe51f289bfa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:32.548454 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3a52894c-2948-46fa-a606-4fe51f289bfa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:32.555367 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a52894c-2948-46fa-a606-4fe51f289bfa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:32.555825 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a52894c-2948-46fa-a606-4fe51f289bfa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:32.556644 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a52894c-2948-46fa-a606-4fe51f289bfa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:32.557169 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a52894c-2948-46fa-a606-4fe51f289bfa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:32.704602 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3a52894c-2948-46fa-a606-4fe51f289bfa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:32.712870 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3a52894c-2948-46fa-a606-4fe51f289bfa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:32.715618 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3a52894c-2948-46fa-a606-4fe51f289bfa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:32.717103 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3a52894c-2948-46fa-a606-4fe51f289bfa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.173114 Jan 05 15:01:32.718373 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 172/337] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:32 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:32.754666 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-19279ea8-4cfc-47e2-a179-6f73118388b3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:32.755859 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-19279ea8-4cfc-47e2-a179-6f73118388b3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:32.761354 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-19279ea8-4cfc-47e2-a179-6f73118388b3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:32.761798 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-19279ea8-4cfc-47e2-a179-6f73118388b3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:32.762610 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-19279ea8-4cfc-47e2-a179-6f73118388b3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:32.762982 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-19279ea8-4cfc-47e2-a179-6f73118388b3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:32.787731 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-19279ea8-4cfc-47e2-a179-6f73118388b3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Going to try to terminate instance {{(pid=128789) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:01:32.937811 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3175a5e6-5ec0-4e91-9bd1-1dd50fbfb5e0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:32.938412 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3175a5e6-5ec0-4e91-9bd1-1dd50fbfb5e0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:32.944402 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3175a5e6-5ec0-4e91-9bd1-1dd50fbfb5e0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:32.944861 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3175a5e6-5ec0-4e91-9bd1-1dd50fbfb5e0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:32.945730 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3175a5e6-5ec0-4e91-9bd1-1dd50fbfb5e0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:32.946159 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3175a5e6-5ec0-4e91-9bd1-1dd50fbfb5e0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:33.087520 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3175a5e6-5ec0-4e91-9bd1-1dd50fbfb5e0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:33.096431 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3175a5e6-5ec0-4e91-9bd1-1dd50fbfb5e0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1721 microversion: 2.1 time: 0.162260 Jan 05 15:01:33.108765 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 173/338] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:32 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:33.108765 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-249c57e6-d740-4bf3-bdaf-5b01b4484777 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:33.108765 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-249c57e6-d740-4bf3-bdaf-5b01b4484777 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:33.108765 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-249c57e6-d740-4bf3-bdaf-5b01b4484777 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:33.109947 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-249c57e6-d740-4bf3-bdaf-5b01b4484777 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:33.109947 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-249c57e6-d740-4bf3-bdaf-5b01b4484777 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:33.110482 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-249c57e6-d740-4bf3-bdaf-5b01b4484777 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:33.160339 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-19279ea8-4cfc-47e2-a179-6f73118388b3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 204 len: 0 microversion: 2.1 time: 0.409188 Jan 05 15:01:33.160938 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 166/339] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:01:32 2022] DELETE /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:01:33.169727 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-61aa6a39-4d7e-47d0-bd63-66ced26101a8 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:33.170457 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-61aa6a39-4d7e-47d0-bd63-66ced26101a8 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:33.176516 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-61aa6a39-4d7e-47d0-bd63-66ced26101a8 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:33.176968 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-61aa6a39-4d7e-47d0-bd63-66ced26101a8 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:33.177818 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-61aa6a39-4d7e-47d0-bd63-66ced26101a8 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:33.178244 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-61aa6a39-4d7e-47d0-bd63-66ced26101a8 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:33.274077 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-249c57e6-d740-4bf3-bdaf-5b01b4484777 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:33.285944 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-249c57e6-d740-4bf3-bdaf-5b01b4484777 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1509 microversion: 2.1 time: 0.186227 Jan 05 15:01:33.287035 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 174/340] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:33 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:33.335978 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-61aa6a39-4d7e-47d0-bd63-66ced26101a8 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:33.343329 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-61aa6a39-4d7e-47d0-bd63-66ced26101a8 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 200 len: 1503 microversion: 2.1 time: 0.177633 Jan 05 15:01:33.343898 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 167/341] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:33 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:33.736262 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1ce60ae5-14fd-4fe7-91e0-a008f67c4ead tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:33.736870 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1ce60ae5-14fd-4fe7-91e0-a008f67c4ead tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:33.743290 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ce60ae5-14fd-4fe7-91e0-a008f67c4ead tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:33.743734 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ce60ae5-14fd-4fe7-91e0-a008f67c4ead tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:33.744504 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ce60ae5-14fd-4fe7-91e0-a008f67c4ead tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:33.744930 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ce60ae5-14fd-4fe7-91e0-a008f67c4ead tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:33.905139 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1ce60ae5-14fd-4fe7-91e0-a008f67c4ead tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:33.913027 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1ce60ae5-14fd-4fe7-91e0-a008f67c4ead tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:33.914875 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1ce60ae5-14fd-4fe7-91e0-a008f67c4ead tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:33.915965 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1ce60ae5-14fd-4fe7-91e0-a008f67c4ead tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.183384 Jan 05 15:01:33.916730 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 175/342] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:33 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:34.115554 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3ca32118-8129-42a5-9032-e040d0854380 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:34.116808 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3ca32118-8129-42a5-9032-e040d0854380 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:34.123585 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3ca32118-8129-42a5-9032-e040d0854380 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:34.124084 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3ca32118-8129-42a5-9032-e040d0854380 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:34.125485 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3ca32118-8129-42a5-9032-e040d0854380 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:34.126145 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3ca32118-8129-42a5-9032-e040d0854380 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:34.292786 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3ca32118-8129-42a5-9032-e040d0854380 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:34.303647 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2de5b04c-e450-446a-991c-b42b32ac2628 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:34.304207 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2de5b04c-e450-446a-991c-b42b32ac2628 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:34.317867 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2de5b04c-e450-446a-991c-b42b32ac2628 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:34.319876 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2de5b04c-e450-446a-991c-b42b32ac2628 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:34.319876 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2de5b04c-e450-446a-991c-b42b32ac2628 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:34.319876 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2de5b04c-e450-446a-991c-b42b32ac2628 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:34.324306 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3ca32118-8129-42a5-9032-e040d0854380 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1721 microversion: 2.1 time: 0.212387 Jan 05 15:01:34.324890 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 168/343] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:34 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:34.363613 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-94808a5b-7e81-4834-bcce-8abb43b82c16 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:34.364250 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-94808a5b-7e81-4834-bcce-8abb43b82c16 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:34.370380 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-94808a5b-7e81-4834-bcce-8abb43b82c16 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:34.370834 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-94808a5b-7e81-4834-bcce-8abb43b82c16 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:34.372109 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-94808a5b-7e81-4834-bcce-8abb43b82c16 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:34.372752 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-94808a5b-7e81-4834-bcce-8abb43b82c16 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:34.579633 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-2de5b04c-e450-446a-991c-b42b32ac2628 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:34.588104 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2de5b04c-e450-446a-991c-b42b32ac2628 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1515 microversion: 2.1 time: 0.287988 Jan 05 15:01:34.588767 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 176/344] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:34 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1515 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:34.729965 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-94808a5b-7e81-4834-bcce-8abb43b82c16 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:34.739096 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-94808a5b-7e81-4834-bcce-8abb43b82c16 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 200 len: 1503 microversion: 2.1 time: 0.382825 Jan 05 15:01:34.739670 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 169/345] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:34 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 1503 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:34.935572 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-65fae50c-9a57-4dc6-a8de-28110e910982 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:34.936277 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-65fae50c-9a57-4dc6-a8de-28110e910982 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:34.942981 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65fae50c-9a57-4dc6-a8de-28110e910982 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:34.943438 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65fae50c-9a57-4dc6-a8de-28110e910982 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:34.949908 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65fae50c-9a57-4dc6-a8de-28110e910982 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:34.949908 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65fae50c-9a57-4dc6-a8de-28110e910982 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:35.079624 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-65fae50c-9a57-4dc6-a8de-28110e910982 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:35.087620 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-65fae50c-9a57-4dc6-a8de-28110e910982 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:35.089155 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-65fae50c-9a57-4dc6-a8de-28110e910982 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:35.090291 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-65fae50c-9a57-4dc6-a8de-28110e910982 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.158734 Jan 05 15:01:35.091090 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 177/346] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:34 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:01:35.341346 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-60f5ba97-db03-4520-b0da-e3d0c34b4a15 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:35.341951 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-60f5ba97-db03-4520-b0da-e3d0c34b4a15 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:35.348221 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-60f5ba97-db03-4520-b0da-e3d0c34b4a15 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:35.353384 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-60f5ba97-db03-4520-b0da-e3d0c34b4a15 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:35.353384 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-60f5ba97-db03-4520-b0da-e3d0c34b4a15 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:35.353384 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-60f5ba97-db03-4520-b0da-e3d0c34b4a15 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:35.486199 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-60f5ba97-db03-4520-b0da-e3d0c34b4a15 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:35.494354 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-60f5ba97-db03-4520-b0da-e3d0c34b4a15 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1721 microversion: 2.1 time: 0.156956 Jan 05 15:01:35.494927 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 170/347] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:35 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:35.755967 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-62245efc-90eb-40e4-9781-90e25246eafb tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:35.756771 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-62245efc-90eb-40e4-9781-90e25246eafb tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:35.762909 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62245efc-90eb-40e4-9781-90e25246eafb tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:35.763367 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62245efc-90eb-40e4-9781-90e25246eafb tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:35.764142 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62245efc-90eb-40e4-9781-90e25246eafb tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:35.765151 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62245efc-90eb-40e4-9781-90e25246eafb tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:35.938340 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-62245efc-90eb-40e4-9781-90e25246eafb tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:35.946135 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-62245efc-90eb-40e4-9781-90e25246eafb tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 200 len: 1503 microversion: 2.1 time: 0.194296 Jan 05 15:01:35.946695 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 178/348] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:35 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:36.108046 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a7c30e00-800f-44bd-91a2-7e0cc31a35e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:36.109763 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a7c30e00-800f-44bd-91a2-7e0cc31a35e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:36.116046 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a7c30e00-800f-44bd-91a2-7e0cc31a35e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:36.116627 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a7c30e00-800f-44bd-91a2-7e0cc31a35e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:36.117604 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a7c30e00-800f-44bd-91a2-7e0cc31a35e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:36.118309 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a7c30e00-800f-44bd-91a2-7e0cc31a35e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:36.150561 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6cd363a6-3702-4af1-ad17-737fc7f16c13 req-181992fc-d822-466a-912e-4a4246f71d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c747ca1-458e-4b0c-aa5f-fa911f90280e", "name": "network-vif-deleted", "tag": "1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:36.152004 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:01:36.152004 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:01:36.159897 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6cd363a6-3702-4af1-ad17-737fc7f16c13 req-181992fc-d822-466a-912e-4a4246f71d92 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:36.160262 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6cd363a6-3702-4af1-ad17-737fc7f16c13 req-181992fc-d822-466a-912e-4a4246f71d92 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:36.171860 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6cd363a6-3702-4af1-ad17-737fc7f16c13 req-181992fc-d822-466a-912e-4a4246f71d92 service nova] Creating event network-vif-deleted:1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 for instance 4c747ca1-458e-4b0c-aa5f-fa911f90280e on hv-cinder-maste Jan 05 15:01:36.177045 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6cd363a6-3702-4af1-ad17-737fc7f16c13 req-181992fc-d822-466a-912e-4a4246f71d92 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030203 Jan 05 15:01:36.177782 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 179/349] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:01:36.318635 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a7c30e00-800f-44bd-91a2-7e0cc31a35e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:36.319950 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a7c30e00-800f-44bd-91a2-7e0cc31a35e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:36.321601 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a7c30e00-800f-44bd-91a2-7e0cc31a35e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:36.322997 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a7c30e00-800f-44bd-91a2-7e0cc31a35e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.219118 Jan 05 15:01:36.323632 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 171/350] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:36 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:36.326745 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5960518d-bedb-4060-af03-02198816da40 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:36.327954 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5960518d-bedb-4060-af03-02198816da40 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:36.334527 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5960518d-bedb-4060-af03-02198816da40 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:36.335181 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5960518d-bedb-4060-af03-02198816da40 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:36.336046 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5960518d-bedb-4060-af03-02198816da40 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:36.336539 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5960518d-bedb-4060-af03-02198816da40 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:36.485585 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-5960518d-bedb-4060-af03-02198816da40 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:36.492877 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5960518d-bedb-4060-af03-02198816da40 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1515 microversion: 2.1 time: 0.171981 Jan 05 15:01:36.493502 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 180/351] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:36 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:36.510794 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b471b36f-1275-4164-901f-1cddaeba65ee tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "707a1b94-49a8-4177-9aa3-2f4feadcbc10"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:36.511980 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0c6e84ed-f781-4b99-82f0-28986f3c9899 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:36.512660 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0c6e84ed-f781-4b99-82f0-28986f3c9899 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:36.519704 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b471b36f-1275-4164-901f-1cddaeba65ee tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:36.520727 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c6e84ed-f781-4b99-82f0-28986f3c9899 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:36.521281 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c6e84ed-f781-4b99-82f0-28986f3c9899 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:36.522074 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c6e84ed-f781-4b99-82f0-28986f3c9899 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:36.522506 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c6e84ed-f781-4b99-82f0-28986f3c9899 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:36.527450 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b471b36f-1275-4164-901f-1cddaeba65ee tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:36.527904 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b471b36f-1275-4164-901f-1cddaeba65ee tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:36.528703 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b471b36f-1275-4164-901f-1cddaeba65ee tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:36.529209 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b471b36f-1275-4164-901f-1cddaeba65ee tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:36.682983 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-0c6e84ed-f781-4b99-82f0-28986f3c9899 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:36.692058 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0c6e84ed-f781-4b99-82f0-28986f3c9899 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1721 microversion: 2.1 time: 0.184240 Jan 05 15:01:36.692839 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 181/352] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:36 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:36.966332 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7e2b4f40-c8e9-4ffc-929c-6e332cc2c6db tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:36.966332 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7e2b4f40-c8e9-4ffc-929c-6e332cc2c6db tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:36.969884 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e2b4f40-c8e9-4ffc-929c-6e332cc2c6db tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:36.970333 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e2b4f40-c8e9-4ffc-929c-6e332cc2c6db tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:36.971214 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e2b4f40-c8e9-4ffc-929c-6e332cc2c6db tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:36.971649 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e2b4f40-c8e9-4ffc-929c-6e332cc2c6db tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:37.005052 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e2b4f40-c8e9-4ffc-929c-6e332cc2c6db tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:37.005525 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e2b4f40-c8e9-4ffc-929c-6e332cc2c6db tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:37.006149 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-7e2b4f40-c8e9-4ffc-929c-6e332cc2c6db tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lazy-loading 'fault' on Instance uuid 4c747ca1-458e-4b0c-aa5f-fa911f90280e {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:01:37.052167 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-7e2b4f40-c8e9-4ffc-929c-6e332cc2c6db tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:37.059383 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7e2b4f40-c8e9-4ffc-929c-6e332cc2c6db tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 200 len: 1303 microversion: 2.1 time: 0.100404 Jan 05 15:01:37.059939 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 182/353] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:36 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:37.342271 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-71c711c9-9683-4011-a196-38a50b3c55ef tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:37.342878 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-71c711c9-9683-4011-a196-38a50b3c55ef tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:37.350090 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71c711c9-9683-4011-a196-38a50b3c55ef tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:37.350537 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71c711c9-9683-4011-a196-38a50b3c55ef tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:37.351562 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71c711c9-9683-4011-a196-38a50b3c55ef tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:37.351996 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71c711c9-9683-4011-a196-38a50b3c55ef tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:37.518203 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-71c711c9-9683-4011-a196-38a50b3c55ef tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:37.524576 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b471b36f-1275-4164-901f-1cddaeba65ee tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "POST /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.018887 Jan 05 15:01:37.531664 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 172/354] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Jan 5 15:01:36 2022] POST /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/os-volume_attachments => generated 194 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:01:37.531789 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-71c711c9-9683-4011-a196-38a50b3c55ef tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:37.531789 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-71c711c9-9683-4011-a196-38a50b3c55ef tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:37.531789 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-71c711c9-9683-4011-a196-38a50b3c55ef tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.191242 Jan 05 15:01:37.539864 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 183/355] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:37 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:37.709829 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-29dd7d57-350f-45fc-b1dc-1ebb26897329 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:37.710528 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-29dd7d57-350f-45fc-b1dc-1ebb26897329 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:37.716586 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-29dd7d57-350f-45fc-b1dc-1ebb26897329 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:37.717035 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-29dd7d57-350f-45fc-b1dc-1ebb26897329 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:37.717836 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-29dd7d57-350f-45fc-b1dc-1ebb26897329 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:37.718946 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-29dd7d57-350f-45fc-b1dc-1ebb26897329 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:37.857787 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-29dd7d57-350f-45fc-b1dc-1ebb26897329 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:37.866786 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-29dd7d57-350f-45fc-b1dc-1ebb26897329 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1721 microversion: 2.1 time: 0.160912 Jan 05 15:01:37.867825 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 173/356] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:37 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:38.076162 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f2eb6339-50e9-4998-8466-06fd772d2e20 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:38.076800 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f2eb6339-50e9-4998-8466-06fd772d2e20 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 4c747ca1-458e-4b0c-aa5f-fa911f90280e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:38.090420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2eb6339-50e9-4998-8466-06fd772d2e20 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:38.090420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2eb6339-50e9-4998-8466-06fd772d2e20 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:38.090420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2eb6339-50e9-4998-8466-06fd772d2e20 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:38.090420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2eb6339-50e9-4998-8466-06fd772d2e20 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:38.098082 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f2eb6339-50e9-4998-8466-06fd772d2e20 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] HTTP exception thrown: Instance 4c747ca1-458e-4b0c-aa5f-fa911f90280e could not be found. Jan 05 15:01:38.098668 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f2eb6339-50e9-4998-8466-06fd772d2e20 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Returning 404 to user: Instance 4c747ca1-458e-4b0c-aa5f-fa911f90280e could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:01:38.099475 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f2eb6339-50e9-4998-8466-06fd772d2e20 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e" status: 404 len: 111 microversion: 2.1 time: 0.027116 Jan 05 15:01:38.100012 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 184/357] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:38 2022] GET /compute/v2.1/servers/4c747ca1-458e-4b0c-aa5f-fa911f90280e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:01:38.206906 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-56196d76-ace3-43af-845c-24f5a55d987e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-954984813", "imageRef": "e4c11159-1e41-437a-af97-eb5f10704ae6", "flavorRef": "452", "networks": [{"uuid": "aec55d3c-7bde-4a3f-bf24-eddde8e56c38"}]}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:38.275928 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.network.neutron [None req-56196d76-ace3-43af-845c-24f5a55d987e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] validate_networks() for [('aec55d3c-7bde-4a3f-bf24-eddde8e56c38', None, None, None, None, None)] {{(pid=128789) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 15:01:38.556802 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6219afb2-94dd-4253-b71f-22ed58b76e63 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:38.557413 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6219afb2-94dd-4253-b71f-22ed58b76e63 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:38.567320 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6219afb2-94dd-4253-b71f-22ed58b76e63 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:38.567320 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6219afb2-94dd-4253-b71f-22ed58b76e63 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:38.567320 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6219afb2-94dd-4253-b71f-22ed58b76e63 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:38.567320 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6219afb2-94dd-4253-b71f-22ed58b76e63 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:38.639980 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-56196d76-ace3-43af-845c-24f5a55d987e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Flavor limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 15:01:38.640463 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-56196d76-ace3-43af-845c-24f5a55d987e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Image limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 15:01:38.640882 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-56196d76-ace3-43af-845c-24f5a55d987e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Flavor pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 15:01:38.641464 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-56196d76-ace3-43af-845c-24f5a55d987e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Image pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 15:01:38.642032 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-56196d76-ace3-43af-845c-24f5a55d987e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 15:01:38.652275 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-56196d76-ace3-43af-845c-24f5a55d987e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:38.653183 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-56196d76-ace3-43af-845c-24f5a55d987e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:38.654312 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-56196d76-ace3-43af-845c-24f5a55d987e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:38.654744 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-56196d76-ace3-43af-845c-24f5a55d987e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:38.672589 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-56196d76-ace3-43af-845c-24f5a55d987e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Getting quotas for project e785ec07120a4184acdbf74f73489ce8. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:01:38.677738 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-56196d76-ace3-43af-845c-24f5a55d987e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Getting quotas for user 0669d8dce2d64715948615519bf0eac9 and project e785ec07120a4184acdbf74f73489ce8. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:01:38.691907 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-56196d76-ace3-43af-845c-24f5a55d987e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Going to run 1 instances... {{(pid=128789) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 15:01:38.694513 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-56196d76-ace3-43af-845c-24f5a55d987e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4c11159-1e41-437a-af97-eb5f10704ae6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 15:01:38.709941 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6219afb2-94dd-4253-b71f-22ed58b76e63 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:38.717876 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6219afb2-94dd-4253-b71f-22ed58b76e63 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:38.720137 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6219afb2-94dd-4253-b71f-22ed58b76e63 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:38.721312 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6219afb2-94dd-4253-b71f-22ed58b76e63 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.168257 Jan 05 15:01:38.721865 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 185/358] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:38 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:01:38.885197 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8c336c26-ec91-4ac0-96c9-de473a090e5b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:38.885197 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8c336c26-ec91-4ac0-96c9-de473a090e5b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:38.897977 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c336c26-ec91-4ac0-96c9-de473a090e5b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:38.898423 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c336c26-ec91-4ac0-96c9-de473a090e5b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:38.899518 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c336c26-ec91-4ac0-96c9-de473a090e5b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:38.899963 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c336c26-ec91-4ac0-96c9-de473a090e5b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:38.906448 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-56196d76-ace3-43af-845c-24f5a55d987e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703285 Jan 05 15:01:38.925231 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 174/359] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 15:01:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 15:01:38.927699 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-bdd02c5d-e288-4b1a-9019-8d6f61d1cf79 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:38.928436 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-bdd02c5d-e288-4b1a-9019-8d6f61d1cf79 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:38.992496 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-bdd02c5d-e288-4b1a-9019-8d6f61d1cf79 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:39.007806 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-bdd02c5d-e288-4b1a-9019-8d6f61d1cf79 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1213 microversion: 2.1 time: 0.088870 Jan 05 15:01:39.009113 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 175/360] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:38 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:39.084733 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8c336c26-ec91-4ac0-96c9-de473a090e5b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:39.098154 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8c336c26-ec91-4ac0-96c9-de473a090e5b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1721 microversion: 2.1 time: 0.213036 Jan 05 15:01:39.098154 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 186/361] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:38 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:39.739636 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-4e116ea6-7f40-4560-9e75-c2cf0e20f76b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:39.740280 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-4e116ea6-7f40-4560-9e75-c2cf0e20f76b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:39.746204 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4e116ea6-7f40-4560-9e75-c2cf0e20f76b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:39.746649 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4e116ea6-7f40-4560-9e75-c2cf0e20f76b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:39.747424 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4e116ea6-7f40-4560-9e75-c2cf0e20f76b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:39.747859 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4e116ea6-7f40-4560-9e75-c2cf0e20f76b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:39.878917 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-4e116ea6-7f40-4560-9e75-c2cf0e20f76b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:39.887229 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-4e116ea6-7f40-4560-9e75-c2cf0e20f76b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:39.891991 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-4e116ea6-7f40-4560-9e75-c2cf0e20f76b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:39.892695 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-4e116ea6-7f40-4560-9e75-c2cf0e20f76b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.156804 Jan 05 15:01:39.893272 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 176/362] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:39 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:40.025659 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a3e3f2fd-7431-4af9-8a00-803539cb83b8 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:40.026882 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a3e3f2fd-7431-4af9-8a00-803539cb83b8 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:40.033936 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e3f2fd-7431-4af9-8a00-803539cb83b8 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:40.034430 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e3f2fd-7431-4af9-8a00-803539cb83b8 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:40.035320 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e3f2fd-7431-4af9-8a00-803539cb83b8 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:40.035786 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e3f2fd-7431-4af9-8a00-803539cb83b8 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:40.094905 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a3e3f2fd-7431-4af9-8a00-803539cb83b8 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:40.102471 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a3e3f2fd-7431-4af9-8a00-803539cb83b8 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1217 microversion: 2.1 time: 0.080649 Jan 05 15:01:40.112246 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 187/363] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:40 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:40.117330 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a187394f-4a90-4e96-9eeb-8773326a037d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:40.117942 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a187394f-4a90-4e96-9eeb-8773326a037d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:40.123824 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a187394f-4a90-4e96-9eeb-8773326a037d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:40.124342 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a187394f-4a90-4e96-9eeb-8773326a037d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:40.126147 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a187394f-4a90-4e96-9eeb-8773326a037d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:40.133339 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a187394f-4a90-4e96-9eeb-8773326a037d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:40.269566 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a187394f-4a90-4e96-9eeb-8773326a037d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:40.277438 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a187394f-4a90-4e96-9eeb-8773326a037d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1721 microversion: 2.1 time: 0.164347 Jan 05 15:01:40.278005 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 177/364] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:40 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:40.911564 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9d2081c4-667c-45b8-848c-a15ab7228cd5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:40.912162 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9d2081c4-667c-45b8-848c-a15ab7228cd5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:40.918036 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d2081c4-667c-45b8-848c-a15ab7228cd5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:40.918476 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d2081c4-667c-45b8-848c-a15ab7228cd5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:40.919238 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d2081c4-667c-45b8-848c-a15ab7228cd5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:40.919680 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d2081c4-667c-45b8-848c-a15ab7228cd5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:41.061698 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-9d2081c4-667c-45b8-848c-a15ab7228cd5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:41.069919 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-9d2081c4-667c-45b8-848c-a15ab7228cd5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:41.071410 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-9d2081c4-667c-45b8-848c-a15ab7228cd5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:41.072541 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9d2081c4-667c-45b8-848c-a15ab7228cd5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.164658 Jan 05 15:01:41.073346 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 188/365] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:40 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:41.119046 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d7877615-4ac1-4043-9176-ec4d379dfee4 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:41.120204 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d7877615-4ac1-4043-9176-ec4d379dfee4 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:41.129004 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d7877615-4ac1-4043-9176-ec4d379dfee4 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:41.129476 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d7877615-4ac1-4043-9176-ec4d379dfee4 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:41.130246 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d7877615-4ac1-4043-9176-ec4d379dfee4 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:41.130700 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d7877615-4ac1-4043-9176-ec4d379dfee4 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:41.196000 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d7877615-4ac1-4043-9176-ec4d379dfee4 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:41.203759 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d7877615-4ac1-4043-9176-ec4d379dfee4 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1265 microversion: 2.1 time: 0.088308 Jan 05 15:01:41.204553 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 178/366] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:41 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:41.295171 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f6e433cb-78d4-4d1f-85bd-c2f816af8dce tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:41.295790 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f6e433cb-78d4-4d1f-85bd-c2f816af8dce tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:41.305429 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6e433cb-78d4-4d1f-85bd-c2f816af8dce tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:41.305874 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6e433cb-78d4-4d1f-85bd-c2f816af8dce tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:41.306756 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6e433cb-78d4-4d1f-85bd-c2f816af8dce tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:41.307227 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6e433cb-78d4-4d1f-85bd-c2f816af8dce tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:41.437678 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-f6e433cb-78d4-4d1f-85bd-c2f816af8dce tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:41.446386 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f6e433cb-78d4-4d1f-85bd-c2f816af8dce tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1721 microversion: 2.1 time: 0.154617 Jan 05 15:01:41.450990 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 189/367] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:41 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:42.092917 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e199774c-cb64-44e2-9a90-c2c61bc1b466 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:42.098811 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e199774c-cb64-44e2-9a90-c2c61bc1b466 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:42.099852 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e199774c-cb64-44e2-9a90-c2c61bc1b466 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:42.100498 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e199774c-cb64-44e2-9a90-c2c61bc1b466 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:42.101521 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e199774c-cb64-44e2-9a90-c2c61bc1b466 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:42.102123 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e199774c-cb64-44e2-9a90-c2c61bc1b466 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:42.243978 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7dd5ed71-7557-4071-bbbb-7c0cd39c7a26 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:42.244764 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7dd5ed71-7557-4071-bbbb-7c0cd39c7a26 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:42.251943 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dd5ed71-7557-4071-bbbb-7c0cd39c7a26 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:42.252482 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dd5ed71-7557-4071-bbbb-7c0cd39c7a26 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:42.253417 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dd5ed71-7557-4071-bbbb-7c0cd39c7a26 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:42.257446 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dd5ed71-7557-4071-bbbb-7c0cd39c7a26 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:42.298377 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e199774c-cb64-44e2-9a90-c2c61bc1b466 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:42.306937 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e199774c-cb64-44e2-9a90-c2c61bc1b466 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:42.308770 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e199774c-cb64-44e2-9a90-c2c61bc1b466 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:42.309948 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e199774c-cb64-44e2-9a90-c2c61bc1b466 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.220785 Jan 05 15:01:42.310504 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 179/368] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:42 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:01:42.433352 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-7dd5ed71-7557-4071-bbbb-7c0cd39c7a26 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:42.441205 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7dd5ed71-7557-4071-bbbb-7c0cd39c7a26 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.218629 Jan 05 15:01:42.441773 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 190/369] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:42 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:42.463347 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6ba4efcd-c223-47cc-a736-4979ddcdbd41 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:42.464101 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-6ba4efcd-c223-47cc-a736-4979ddcdbd41 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:42.470515 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6ba4efcd-c223-47cc-a736-4979ddcdbd41 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:42.470964 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6ba4efcd-c223-47cc-a736-4979ddcdbd41 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:42.471837 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6ba4efcd-c223-47cc-a736-4979ddcdbd41 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:42.472269 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6ba4efcd-c223-47cc-a736-4979ddcdbd41 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:42.625040 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-6ba4efcd-c223-47cc-a736-4979ddcdbd41 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:42.633226 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6ba4efcd-c223-47cc-a736-4979ddcdbd41 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1721 microversion: 2.1 time: 0.173501 Jan 05 15:01:42.633789 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 180/370] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:42 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:43.295561 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6f36758c-8229-4064-918d-ebe505721cb5 req-0cddf29a-d295-461c-94f0-2e8466a2401f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69165fdc-1854-4f3f-a46a-6727d1bf96bc", "tag": "32e7c026-6194-414c-8f67-f9b7c7e9a4d0"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:43.297851 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:01:43.297851 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:01:43.305194 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6f36758c-8229-4064-918d-ebe505721cb5 req-0cddf29a-d295-461c-94f0-2e8466a2401f service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:43.305638 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6f36758c-8229-4064-918d-ebe505721cb5 req-0cddf29a-d295-461c-94f0-2e8466a2401f service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:43.316721 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6f36758c-8229-4064-918d-ebe505721cb5 req-0cddf29a-d295-461c-94f0-2e8466a2401f service nova] Creating event network-changed:32e7c026-6194-414c-8f67-f9b7c7e9a4d0 for instance 69165fdc-1854-4f3f-a46a-6727d1bf96bc on hv-cinder-maste Jan 05 15:01:43.323242 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6f36758c-8229-4064-918d-ebe505721cb5 req-0cddf29a-d295-461c-94f0-2e8466a2401f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031154 Jan 05 15:01:43.323996 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 191/371] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:01:43.336101 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-43cd6160-13de-4055-bbe0-c3193e37d722 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:43.336736 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-43cd6160-13de-4055-bbe0-c3193e37d722 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:43.342821 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-43cd6160-13de-4055-bbe0-c3193e37d722 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:43.343792 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-43cd6160-13de-4055-bbe0-c3193e37d722 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:43.344569 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-43cd6160-13de-4055-bbe0-c3193e37d722 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:43.344996 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-43cd6160-13de-4055-bbe0-c3193e37d722 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:43.458219 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-91421d68-38f6-4df0-a0f7-aea8aebdad74 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:43.465183 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-91421d68-38f6-4df0-a0f7-aea8aebdad74 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:43.465183 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91421d68-38f6-4df0-a0f7-aea8aebdad74 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:43.465553 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91421d68-38f6-4df0-a0f7-aea8aebdad74 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:43.466107 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91421d68-38f6-4df0-a0f7-aea8aebdad74 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:43.466532 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91421d68-38f6-4df0-a0f7-aea8aebdad74 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:43.480180 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-43cd6160-13de-4055-bbe0-c3193e37d722 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:43.492845 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-43cd6160-13de-4055-bbe0-c3193e37d722 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:43.494401 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-43cd6160-13de-4055-bbe0-c3193e37d722 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:43.495769 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-43cd6160-13de-4055-bbe0-c3193e37d722 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.170094 Jan 05 15:01:43.496354 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 181/372] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:43 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:43.606134 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-91421d68-38f6-4df0-a0f7-aea8aebdad74 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:43.615749 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-91421d68-38f6-4df0-a0f7-aea8aebdad74 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.161493 Jan 05 15:01:43.616328 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 192/373] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:43 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:43.650169 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-46026a69-9892-4ff1-a3a4-0562402187ab tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:43.650776 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-46026a69-9892-4ff1-a3a4-0562402187ab tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:43.657530 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-46026a69-9892-4ff1-a3a4-0562402187ab tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:43.657974 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-46026a69-9892-4ff1-a3a4-0562402187ab tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:43.658739 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-46026a69-9892-4ff1-a3a4-0562402187ab tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:43.659199 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-46026a69-9892-4ff1-a3a4-0562402187ab tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:43.795497 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-46026a69-9892-4ff1-a3a4-0562402187ab tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:43.803128 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-46026a69-9892-4ff1-a3a4-0562402187ab tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1721 microversion: 2.1 time: 0.156675 Jan 05 15:01:43.803685 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 182/374] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:43 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:44.513548 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-981ad3ee-f178-4895-937e-1dcf22dcc74a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:44.513962 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-981ad3ee-f178-4895-937e-1dcf22dcc74a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:44.519895 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-981ad3ee-f178-4895-937e-1dcf22dcc74a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:44.520336 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-981ad3ee-f178-4895-937e-1dcf22dcc74a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:44.521204 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-981ad3ee-f178-4895-937e-1dcf22dcc74a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:44.521638 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-981ad3ee-f178-4895-937e-1dcf22dcc74a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:44.634348 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-654997c6-bef5-4648-9827-bbbe3ccc6b11 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:44.635775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-654997c6-bef5-4648-9827-bbbe3ccc6b11 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:44.643378 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-654997c6-bef5-4648-9827-bbbe3ccc6b11 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:44.644587 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-654997c6-bef5-4648-9827-bbbe3ccc6b11 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:44.645011 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-654997c6-bef5-4648-9827-bbbe3ccc6b11 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:44.645529 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-654997c6-bef5-4648-9827-bbbe3ccc6b11 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:44.656941 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-981ad3ee-f178-4895-937e-1dcf22dcc74a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:44.665162 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-981ad3ee-f178-4895-937e-1dcf22dcc74a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:44.666809 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-981ad3ee-f178-4895-937e-1dcf22dcc74a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:44.668050 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-981ad3ee-f178-4895-937e-1dcf22dcc74a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.158863 Jan 05 15:01:44.668703 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 193/375] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:44 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:44.783673 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-654997c6-bef5-4648-9827-bbbe3ccc6b11 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:44.790879 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-654997c6-bef5-4648-9827-bbbe3ccc6b11 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.162044 Jan 05 15:01:44.791438 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 183/376] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:44 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:44.819278 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-352da257-1a60-488c-accc-39b354d3c1a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:44.819884 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-352da257-1a60-488c-accc-39b354d3c1a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:44.825698 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-352da257-1a60-488c-accc-39b354d3c1a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:44.826145 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-352da257-1a60-488c-accc-39b354d3c1a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:44.826926 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-352da257-1a60-488c-accc-39b354d3c1a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:44.827394 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-352da257-1a60-488c-accc-39b354d3c1a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:44.968944 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-352da257-1a60-488c-accc-39b354d3c1a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:44.976862 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-352da257-1a60-488c-accc-39b354d3c1a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1721 microversion: 2.1 time: 0.161156 Jan 05 15:01:44.977524 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 194/377] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:44 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:45.689854 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-be25f463-fbe0-4a85-a22d-9ff5f9c1bbd4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:45.690458 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-be25f463-fbe0-4a85-a22d-9ff5f9c1bbd4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:45.696892 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-be25f463-fbe0-4a85-a22d-9ff5f9c1bbd4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:45.697388 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-be25f463-fbe0-4a85-a22d-9ff5f9c1bbd4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:45.698156 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-be25f463-fbe0-4a85-a22d-9ff5f9c1bbd4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:45.698600 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-be25f463-fbe0-4a85-a22d-9ff5f9c1bbd4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:45.807398 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-977f3d34-1a42-4e47-8d91-b2feb2128e94 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:45.808036 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-977f3d34-1a42-4e47-8d91-b2feb2128e94 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:45.814568 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-977f3d34-1a42-4e47-8d91-b2feb2128e94 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:45.815054 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-977f3d34-1a42-4e47-8d91-b2feb2128e94 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:45.815847 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-977f3d34-1a42-4e47-8d91-b2feb2128e94 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:45.816279 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-977f3d34-1a42-4e47-8d91-b2feb2128e94 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:45.825981 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-be25f463-fbe0-4a85-a22d-9ff5f9c1bbd4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:45.833657 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-be25f463-fbe0-4a85-a22d-9ff5f9c1bbd4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:45.835181 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-be25f463-fbe0-4a85-a22d-9ff5f9c1bbd4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:45.836840 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-be25f463-fbe0-4a85-a22d-9ff5f9c1bbd4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.151206 Jan 05 15:01:45.837435 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 184/378] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:45 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:45.954037 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-977f3d34-1a42-4e47-8d91-b2feb2128e94 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:45.962384 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-977f3d34-1a42-4e47-8d91-b2feb2128e94 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.158396 Jan 05 15:01:45.963151 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 195/379] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:45 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:45.993639 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-246aa409-6f05-467e-b12f-59b6ad0a5aaf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:45.994599 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-246aa409-6f05-467e-b12f-59b6ad0a5aaf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:46.000121 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-246aa409-6f05-467e-b12f-59b6ad0a5aaf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:46.000571 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-246aa409-6f05-467e-b12f-59b6ad0a5aaf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:46.001384 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-246aa409-6f05-467e-b12f-59b6ad0a5aaf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:46.001819 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-246aa409-6f05-467e-b12f-59b6ad0a5aaf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:46.157371 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-246aa409-6f05-467e-b12f-59b6ad0a5aaf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:46.165621 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-246aa409-6f05-467e-b12f-59b6ad0a5aaf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1721 microversion: 2.1 time: 0.175640 Jan 05 15:01:46.166340 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 185/380] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:45 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:46.855735 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80294e7f-cc1e-482a-9dd5-8c5388abe1ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:46.856326 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-80294e7f-cc1e-482a-9dd5-8c5388abe1ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:46.862729 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80294e7f-cc1e-482a-9dd5-8c5388abe1ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:46.863170 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80294e7f-cc1e-482a-9dd5-8c5388abe1ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:46.863926 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80294e7f-cc1e-482a-9dd5-8c5388abe1ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:46.864355 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80294e7f-cc1e-482a-9dd5-8c5388abe1ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:46.983721 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-95a13b5e-a815-4e6d-b02b-2e62379c8741 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:46.984333 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-95a13b5e-a815-4e6d-b02b-2e62379c8741 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:46.992216 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-95a13b5e-a815-4e6d-b02b-2e62379c8741 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:46.992625 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-95a13b5e-a815-4e6d-b02b-2e62379c8741 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:46.993763 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-95a13b5e-a815-4e6d-b02b-2e62379c8741 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:46.994353 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-95a13b5e-a815-4e6d-b02b-2e62379c8741 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:47.035953 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-80294e7f-cc1e-482a-9dd5-8c5388abe1ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:47.044747 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-80294e7f-cc1e-482a-9dd5-8c5388abe1ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:47.047302 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-80294e7f-cc1e-482a-9dd5-8c5388abe1ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:47.048456 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-80294e7f-cc1e-482a-9dd5-8c5388abe1ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.196716 Jan 05 15:01:47.049016 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 196/381] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:46 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:47.140097 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-95a13b5e-a815-4e6d-b02b-2e62379c8741 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:47.148017 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-95a13b5e-a815-4e6d-b02b-2e62379c8741 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.168052 Jan 05 15:01:47.148651 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 186/382] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:46 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:47.182115 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-751c3675-8b66-4a31-88cd-b0328ca0d52c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:47.182844 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-751c3675-8b66-4a31-88cd-b0328ca0d52c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:47.195401 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-751c3675-8b66-4a31-88cd-b0328ca0d52c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:47.196178 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-751c3675-8b66-4a31-88cd-b0328ca0d52c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:47.196646 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-751c3675-8b66-4a31-88cd-b0328ca0d52c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:47.197092 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-751c3675-8b66-4a31-88cd-b0328ca0d52c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:47.428060 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-751c3675-8b66-4a31-88cd-b0328ca0d52c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:47.436021 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-751c3675-8b66-4a31-88cd-b0328ca0d52c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1721 microversion: 2.1 time: 0.257485 Jan 05 15:01:47.436855 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 197/383] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:47 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:48.066177 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d5e3ffad-7abf-4b57-a4d3-85cf7fad572f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:48.066775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d5e3ffad-7abf-4b57-a4d3-85cf7fad572f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:48.073023 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d5e3ffad-7abf-4b57-a4d3-85cf7fad572f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:48.073513 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d5e3ffad-7abf-4b57-a4d3-85cf7fad572f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:48.074260 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d5e3ffad-7abf-4b57-a4d3-85cf7fad572f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:48.074693 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d5e3ffad-7abf-4b57-a4d3-85cf7fad572f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:48.164661 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b9f19381-c316-4a09-afe6-5ccd6bea8bae tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:48.165299 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b9f19381-c316-4a09-afe6-5ccd6bea8bae tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:48.175465 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9f19381-c316-4a09-afe6-5ccd6bea8bae tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:48.175919 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9f19381-c316-4a09-afe6-5ccd6bea8bae tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:48.176705 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9f19381-c316-4a09-afe6-5ccd6bea8bae tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:48.177372 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9f19381-c316-4a09-afe6-5ccd6bea8bae tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:48.212068 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d5e3ffad-7abf-4b57-a4d3-85cf7fad572f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:48.220482 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d5e3ffad-7abf-4b57-a4d3-85cf7fad572f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:48.222019 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d5e3ffad-7abf-4b57-a4d3-85cf7fad572f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:48.223210 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d5e3ffad-7abf-4b57-a4d3-85cf7fad572f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1746 microversion: 2.20 time: 0.160769 Jan 05 15:01:48.223770 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 187/384] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:48 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:01:48.308404 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b9f19381-c316-4a09-afe6-5ccd6bea8bae tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:48.317917 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b9f19381-c316-4a09-afe6-5ccd6bea8bae tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.156869 Jan 05 15:01:48.318496 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 198/385] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:48 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:48.335836 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ec296e1c-b387-41f1-b680-95e7b387c01e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:48.336921 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ec296e1c-b387-41f1-b680-95e7b387c01e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:48.343857 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ec296e1c-b387-41f1-b680-95e7b387c01e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:48.344192 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ec296e1c-b387-41f1-b680-95e7b387c01e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:48.345020 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ec296e1c-b387-41f1-b680-95e7b387c01e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:48.345507 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ec296e1c-b387-41f1-b680-95e7b387c01e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:48.369938 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-ec296e1c-b387-41f1-b680-95e7b387c01e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lazy-loading 'flavor' on Instance uuid 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:01:48.455014 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-87717609-c64b-44f1-b0ff-ebba93b95099 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:48.455865 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-87717609-c64b-44f1-b0ff-ebba93b95099 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:48.462080 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87717609-c64b-44f1-b0ff-ebba93b95099 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:48.462518 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87717609-c64b-44f1-b0ff-ebba93b95099 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:48.463297 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87717609-c64b-44f1-b0ff-ebba93b95099 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:48.463719 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87717609-c64b-44f1-b0ff-ebba93b95099 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:48.604502 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-87717609-c64b-44f1-b0ff-ebba93b95099 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:48.614756 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-87717609-c64b-44f1-b0ff-ebba93b95099 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1698 microversion: 2.1 time: 0.162706 Jan 05 15:01:48.619083 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 199/386] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:48 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:48.629596 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9306e99c-b3e0-4aab-b346-016210d3e02a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:48.635514 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9306e99c-b3e0-4aab-b346-016210d3e02a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:48.637621 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9306e99c-b3e0-4aab-b346-016210d3e02a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:48.694561 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9306e99c-b3e0-4aab-b346-016210d3e02a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Going to try to start instance {{(pid=128788) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 05 15:01:48.767893 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ec296e1c-b387-41f1-b680-95e7b387c01e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "POST /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/action" status: 200 len: 32 microversion: 2.1 time: 0.435745 Jan 05 15:01:48.768541 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 188/387] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:01:48 2022] POST /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/action => generated 32 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:01:48.777853 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-38971215-c5f1-40c7-a2b7-b402bf82c902 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:48.778630 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-38971215-c5f1-40c7-a2b7-b402bf82c902 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:48.784824 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-38971215-c5f1-40c7-a2b7-b402bf82c902 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:48.785317 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-38971215-c5f1-40c7-a2b7-b402bf82c902 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:48.786111 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-38971215-c5f1-40c7-a2b7-b402bf82c902 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:48.789788 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-38971215-c5f1-40c7-a2b7-b402bf82c902 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:48.936267 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-38971215-c5f1-40c7-a2b7-b402bf82c902 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:48.947306 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-38971215-c5f1-40c7-a2b7-b402bf82c902 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.173468 Jan 05 15:01:48.947815 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 189/388] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:48 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:48.963821 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9306e99c-b3e0-4aab-b346-016210d3e02a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 202 len: 0 microversion: 2.1 time: 0.337685 Jan 05 15:01:48.964418 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 200/389] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:01:48 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:01:48.973312 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-fdbdf5df-c6f3-4aab-ad11-f82d8bf7b0ec tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:48.974033 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-fdbdf5df-c6f3-4aab-ad11-f82d8bf7b0ec tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:48.980540 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fdbdf5df-c6f3-4aab-ad11-f82d8bf7b0ec tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:48.981043 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fdbdf5df-c6f3-4aab-ad11-f82d8bf7b0ec tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:48.981908 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fdbdf5df-c6f3-4aab-ad11-f82d8bf7b0ec tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:48.982333 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fdbdf5df-c6f3-4aab-ad11-f82d8bf7b0ec tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:49.115130 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-fdbdf5df-c6f3-4aab-ad11-f82d8bf7b0ec tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:49.122913 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-fdbdf5df-c6f3-4aab-ad11-f82d8bf7b0ec tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1707 microversion: 2.1 time: 0.154108 Jan 05 15:01:49.123467 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 190/390] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:48 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1707 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:49.242839 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-abbeadf8-1081-41dd-88b3-a3675b51681c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:49.243700 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-abbeadf8-1081-41dd-88b3-a3675b51681c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:49.252622 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abbeadf8-1081-41dd-88b3-a3675b51681c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:49.253462 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abbeadf8-1081-41dd-88b3-a3675b51681c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:49.254697 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abbeadf8-1081-41dd-88b3-a3675b51681c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:49.255131 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abbeadf8-1081-41dd-88b3-a3675b51681c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:49.334464 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-839bdb3e-15e7-4fb3-89af-11f28539b8f6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:49.335065 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-839bdb3e-15e7-4fb3-89af-11f28539b8f6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:49.340972 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-839bdb3e-15e7-4fb3-89af-11f28539b8f6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:49.341455 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-839bdb3e-15e7-4fb3-89af-11f28539b8f6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:49.342234 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-839bdb3e-15e7-4fb3-89af-11f28539b8f6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:49.342670 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-839bdb3e-15e7-4fb3-89af-11f28539b8f6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:49.389671 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-abbeadf8-1081-41dd-88b3-a3675b51681c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:49.403815 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-abbeadf8-1081-41dd-88b3-a3675b51681c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:49.405272 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-abbeadf8-1081-41dd-88b3-a3675b51681c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:49.407031 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-abbeadf8-1081-41dd-88b3-a3675b51681c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1746 microversion: 2.20 time: 0.168454 Jan 05 15:01:49.407578 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 201/391] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:49 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:49.481377 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-839bdb3e-15e7-4fb3-89af-11f28539b8f6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:49.489094 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-839bdb3e-15e7-4fb3-89af-11f28539b8f6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.158284 Jan 05 15:01:49.489868 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 191/392] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:49 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:49.963603 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-860a8f0f-761c-4a93-a7c5-cc09e825f52f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:49.964203 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-860a8f0f-761c-4a93-a7c5-cc09e825f52f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:49.971135 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-860a8f0f-761c-4a93-a7c5-cc09e825f52f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:49.971582 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-860a8f0f-761c-4a93-a7c5-cc09e825f52f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:49.972372 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-860a8f0f-761c-4a93-a7c5-cc09e825f52f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:49.972806 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-860a8f0f-761c-4a93-a7c5-cc09e825f52f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:50.109938 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-860a8f0f-761c-4a93-a7c5-cc09e825f52f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:50.117550 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-860a8f0f-761c-4a93-a7c5-cc09e825f52f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.157696 Jan 05 15:01:50.118109 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 202/393] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:49 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:50.144283 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a506c71b-215c-43fb-ac27-ef147fce001c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:50.144283 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a506c71b-215c-43fb-ac27-ef147fce001c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:50.147083 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a506c71b-215c-43fb-ac27-ef147fce001c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:50.147624 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a506c71b-215c-43fb-ac27-ef147fce001c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:50.148509 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a506c71b-215c-43fb-ac27-ef147fce001c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:50.149033 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a506c71b-215c-43fb-ac27-ef147fce001c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:50.280784 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a506c71b-215c-43fb-ac27-ef147fce001c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:50.288463 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a506c71b-215c-43fb-ac27-ef147fce001c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1707 microversion: 2.1 time: 0.152602 Jan 05 15:01:50.289033 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 192/394] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:50 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1707 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:50.425188 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dfb7393c-dda6-4c0e-9b39-09464f0c8477 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:50.425789 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dfb7393c-dda6-4c0e-9b39-09464f0c8477 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:50.432321 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfb7393c-dda6-4c0e-9b39-09464f0c8477 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:50.432765 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfb7393c-dda6-4c0e-9b39-09464f0c8477 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:50.433602 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfb7393c-dda6-4c0e-9b39-09464f0c8477 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:50.434030 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfb7393c-dda6-4c0e-9b39-09464f0c8477 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:50.506151 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-08ca1d46-40a1-41fe-8e7c-35a6beb816e6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:50.506756 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-08ca1d46-40a1-41fe-8e7c-35a6beb816e6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:50.512962 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-08ca1d46-40a1-41fe-8e7c-35a6beb816e6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:50.513135 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-08ca1d46-40a1-41fe-8e7c-35a6beb816e6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:50.513980 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-08ca1d46-40a1-41fe-8e7c-35a6beb816e6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:50.514425 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-08ca1d46-40a1-41fe-8e7c-35a6beb816e6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:50.565615 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-dfb7393c-dda6-4c0e-9b39-09464f0c8477 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:50.573401 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-dfb7393c-dda6-4c0e-9b39-09464f0c8477 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:50.575064 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-dfb7393c-dda6-4c0e-9b39-09464f0c8477 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:50.576217 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dfb7393c-dda6-4c0e-9b39-09464f0c8477 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1746 microversion: 2.20 time: 0.155269 Jan 05 15:01:50.576803 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 203/395] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:50 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:50.640078 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-08ca1d46-40a1-41fe-8e7c-35a6beb816e6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:50.647663 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-08ca1d46-40a1-41fe-8e7c-35a6beb816e6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.145175 Jan 05 15:01:50.648246 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 193/396] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:50 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:51.134389 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3b5c9681-e5ae-4122-a299-847c5b7cceef tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:51.135160 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3b5c9681-e5ae-4122-a299-847c5b7cceef tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:51.141612 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b5c9681-e5ae-4122-a299-847c5b7cceef tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:51.142050 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b5c9681-e5ae-4122-a299-847c5b7cceef tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:51.142814 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b5c9681-e5ae-4122-a299-847c5b7cceef tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:51.143236 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b5c9681-e5ae-4122-a299-847c5b7cceef tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:51.305944 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3a52a55a-d24d-4064-8220-bda25b46ce30 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:51.314776 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3a52a55a-d24d-4064-8220-bda25b46ce30 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:51.314776 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3a52a55a-d24d-4064-8220-bda25b46ce30 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:51.314776 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3a52a55a-d24d-4064-8220-bda25b46ce30 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:51.315839 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3a52a55a-d24d-4064-8220-bda25b46ce30 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:51.316472 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3a52a55a-d24d-4064-8220-bda25b46ce30 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:51.319113 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3b5c9681-e5ae-4122-a299-847c5b7cceef tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:51.335951 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3b5c9681-e5ae-4122-a299-847c5b7cceef tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.204828 Jan 05 15:01:51.337398 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 204/397] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:51 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:51.476090 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3a52a55a-d24d-4064-8220-bda25b46ce30 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:51.486573 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3a52a55a-d24d-4064-8220-bda25b46ce30 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1707 microversion: 2.1 time: 0.183433 Jan 05 15:01:51.497015 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 194/398] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:51 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1707 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:51.599009 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1553c043-7ee3-47d4-a859-8d64c2f34bc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:51.600097 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1553c043-7ee3-47d4-a859-8d64c2f34bc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:51.608966 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1553c043-7ee3-47d4-a859-8d64c2f34bc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:51.612809 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1553c043-7ee3-47d4-a859-8d64c2f34bc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:51.612809 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1553c043-7ee3-47d4-a859-8d64c2f34bc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:51.612809 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1553c043-7ee3-47d4-a859-8d64c2f34bc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:51.664153 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c743bae3-b0b3-49d9-9afa-f0259123ffed tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:51.665128 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c743bae3-b0b3-49d9-9afa-f0259123ffed tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:51.683939 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c743bae3-b0b3-49d9-9afa-f0259123ffed tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:51.684620 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c743bae3-b0b3-49d9-9afa-f0259123ffed tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:51.685951 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c743bae3-b0b3-49d9-9afa-f0259123ffed tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:51.689821 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c743bae3-b0b3-49d9-9afa-f0259123ffed tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:51.859486 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1553c043-7ee3-47d4-a859-8d64c2f34bc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:51.869591 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1553c043-7ee3-47d4-a859-8d64c2f34bc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:51.871512 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1553c043-7ee3-47d4-a859-8d64c2f34bc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:51.872964 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1553c043-7ee3-47d4-a859-8d64c2f34bc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1746 microversion: 2.20 time: 0.282243 Jan 05 15:01:51.873825 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 205/399] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:51 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1746 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:51.963160 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c743bae3-b0b3-49d9-9afa-f0259123ffed tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:51.970926 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c743bae3-b0b3-49d9-9afa-f0259123ffed tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.310445 Jan 05 15:01:51.971775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 195/400] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:51 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:52.352992 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b26a7050-6246-423e-ab65-1ecdcb6939a3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:52.353619 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b26a7050-6246-423e-ab65-1ecdcb6939a3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:52.359753 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b26a7050-6246-423e-ab65-1ecdcb6939a3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:52.360209 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b26a7050-6246-423e-ab65-1ecdcb6939a3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:52.360967 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b26a7050-6246-423e-ab65-1ecdcb6939a3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:52.361416 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b26a7050-6246-423e-ab65-1ecdcb6939a3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:52.489028 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b26a7050-6246-423e-ab65-1ecdcb6939a3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:52.496736 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b26a7050-6246-423e-ab65-1ecdcb6939a3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.147292 Jan 05 15:01:52.497567 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 206/401] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:52 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:52.503031 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-53dbf1ae-5544-448a-be32-558db00e915a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:52.503628 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-53dbf1ae-5544-448a-be32-558db00e915a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:52.509883 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-53dbf1ae-5544-448a-be32-558db00e915a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:52.510327 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-53dbf1ae-5544-448a-be32-558db00e915a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:52.511094 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-53dbf1ae-5544-448a-be32-558db00e915a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:52.511523 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-53dbf1ae-5544-448a-be32-558db00e915a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:52.638429 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-53dbf1ae-5544-448a-be32-558db00e915a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:52.646168 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-53dbf1ae-5544-448a-be32-558db00e915a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1707 microversion: 2.1 time: 0.147341 Jan 05 15:01:52.646727 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 196/402] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:52 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1707 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:52.894193 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1e01f94a-a855-43ce-989a-125ac3268a78 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:52.894793 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1e01f94a-a855-43ce-989a-125ac3268a78 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:52.901028 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e01f94a-a855-43ce-989a-125ac3268a78 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:52.901523 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e01f94a-a855-43ce-989a-125ac3268a78 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:52.902272 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e01f94a-a855-43ce-989a-125ac3268a78 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:52.902698 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e01f94a-a855-43ce-989a-125ac3268a78 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:52.988163 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6a254a39-7de0-4763-9291-77d0ce40fd59 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:52.988769 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-6a254a39-7de0-4763-9291-77d0ce40fd59 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:52.994753 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6a254a39-7de0-4763-9291-77d0ce40fd59 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:52.995195 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6a254a39-7de0-4763-9291-77d0ce40fd59 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:52.995967 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6a254a39-7de0-4763-9291-77d0ce40fd59 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:52.996396 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6a254a39-7de0-4763-9291-77d0ce40fd59 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:53.034989 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e01f94a-a855-43ce-989a-125ac3268a78 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:53.043249 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e01f94a-a855-43ce-989a-125ac3268a78 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:53.044682 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e01f94a-a855-43ce-989a-125ac3268a78 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:53.045852 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1e01f94a-a855-43ce-989a-125ac3268a78 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1746 microversion: 2.20 time: 0.155367 Jan 05 15:01:53.046991 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 207/403] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:52 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:53.127722 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-6a254a39-7de0-4763-9291-77d0ce40fd59 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:53.135314 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6a254a39-7de0-4763-9291-77d0ce40fd59 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.151496 Jan 05 15:01:53.135935 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 197/404] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:52 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:53.346002 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9a892f34-b00d-48c1-98ea-dd796322025a req-73b4b8ba-d781-486e-b784-bb860a416474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "name": "network-vif-plugged", "status": "completed", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:01:53.346002 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:01:53.346002 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:01:53.352816 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9a892f34-b00d-48c1-98ea-dd796322025a req-73b4b8ba-d781-486e-b784-bb860a416474 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:53.353328 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9a892f34-b00d-48c1-98ea-dd796322025a req-73b4b8ba-d781-486e-b784-bb860a416474 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:53.365991 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9a892f34-b00d-48c1-98ea-dd796322025a req-73b4b8ba-d781-486e-b784-bb860a416474 service nova] Creating event network-vif-plugged:45483c3c-9f42-4aff-a962-22ff36647afc for instance 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 on hv-cinder-maste Jan 05 15:01:53.370985 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9a892f34-b00d-48c1-98ea-dd796322025a req-73b4b8ba-d781-486e-b784-bb860a416474 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031982 Jan 05 15:01:53.371552 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 208/405] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:01:53.513939 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-5dcc4279-ae2e-457b-9450-f1110a881e27 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:53.514542 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-5dcc4279-ae2e-457b-9450-f1110a881e27 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:53.521468 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5dcc4279-ae2e-457b-9450-f1110a881e27 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:53.521912 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5dcc4279-ae2e-457b-9450-f1110a881e27 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:53.522711 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5dcc4279-ae2e-457b-9450-f1110a881e27 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:53.523140 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5dcc4279-ae2e-457b-9450-f1110a881e27 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:53.663354 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-587217f1-2040-4a7d-b286-8f0e079ff1f9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:53.663958 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-587217f1-2040-4a7d-b286-8f0e079ff1f9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:53.665853 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-5dcc4279-ae2e-457b-9450-f1110a881e27 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:53.670016 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-587217f1-2040-4a7d-b286-8f0e079ff1f9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:53.670454 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-587217f1-2040-4a7d-b286-8f0e079ff1f9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:53.671364 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-587217f1-2040-4a7d-b286-8f0e079ff1f9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:53.671872 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-587217f1-2040-4a7d-b286-8f0e079ff1f9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:53.673660 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-5dcc4279-ae2e-457b-9450-f1110a881e27 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.163553 Jan 05 15:01:53.674244 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 198/406] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:53 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:53.816001 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-587217f1-2040-4a7d-b286-8f0e079ff1f9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:53.823862 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-587217f1-2040-4a7d-b286-8f0e079ff1f9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1707 microversion: 2.1 time: 0.164850 Jan 05 15:01:53.824420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 209/407] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:53 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1707 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:54.066668 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b02cb8f1-7769-4622-954c-05f9027e5609 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:54.067271 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b02cb8f1-7769-4622-954c-05f9027e5609 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:54.073176 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b02cb8f1-7769-4622-954c-05f9027e5609 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:54.073621 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b02cb8f1-7769-4622-954c-05f9027e5609 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:54.074433 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b02cb8f1-7769-4622-954c-05f9027e5609 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:54.074861 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b02cb8f1-7769-4622-954c-05f9027e5609 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:54.151675 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cc50d6ec-ceb8-45fc-b89f-b8645436970a tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:54.152292 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cc50d6ec-ceb8-45fc-b89f-b8645436970a tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:54.158789 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc50d6ec-ceb8-45fc-b89f-b8645436970a tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:54.159237 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc50d6ec-ceb8-45fc-b89f-b8645436970a tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:54.160030 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc50d6ec-ceb8-45fc-b89f-b8645436970a tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:54.160466 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc50d6ec-ceb8-45fc-b89f-b8645436970a tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:54.205634 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b02cb8f1-7769-4622-954c-05f9027e5609 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:54.213312 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b02cb8f1-7769-4622-954c-05f9027e5609 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:54.214821 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b02cb8f1-7769-4622-954c-05f9027e5609 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:54.215979 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b02cb8f1-7769-4622-954c-05f9027e5609 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1746 microversion: 2.20 time: 0.153416 Jan 05 15:01:54.216551 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 199/408] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:54 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:54.287379 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-cc50d6ec-ceb8-45fc-b89f-b8645436970a tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:54.294468 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cc50d6ec-ceb8-45fc-b89f-b8645436970a tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.146673 Jan 05 15:01:54.295042 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 210/409] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:54 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:54.690421 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-4d584fc5-fc6e-495b-bd43-05e1f4821944 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:54.691025 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-4d584fc5-fc6e-495b-bd43-05e1f4821944 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:54.697392 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4d584fc5-fc6e-495b-bd43-05e1f4821944 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:54.697832 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4d584fc5-fc6e-495b-bd43-05e1f4821944 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:54.698598 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4d584fc5-fc6e-495b-bd43-05e1f4821944 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:54.699023 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4d584fc5-fc6e-495b-bd43-05e1f4821944 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:54.829619 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-4d584fc5-fc6e-495b-bd43-05e1f4821944 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:54.837401 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-4d584fc5-fc6e-495b-bd43-05e1f4821944 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.151038 Jan 05 15:01:54.837956 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 200/410] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:54 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:54.841412 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6d341d57-a252-4f3f-aeb3-69835517dfe2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:54.842015 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6d341d57-a252-4f3f-aeb3-69835517dfe2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:54.847740 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d341d57-a252-4f3f-aeb3-69835517dfe2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:54.848186 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d341d57-a252-4f3f-aeb3-69835517dfe2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:54.848959 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d341d57-a252-4f3f-aeb3-69835517dfe2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:54.849420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d341d57-a252-4f3f-aeb3-69835517dfe2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:54.980907 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6d341d57-a252-4f3f-aeb3-69835517dfe2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:54.989183 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6d341d57-a252-4f3f-aeb3-69835517dfe2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1711 microversion: 2.1 time: 0.151397 Jan 05 15:01:54.989874 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 211/411] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:54 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1711 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:55.235044 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3f36d13d-7307-40db-ab57-d68b8a1490ab tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:55.235640 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3f36d13d-7307-40db-ab57-d68b8a1490ab tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:55.241734 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3f36d13d-7307-40db-ab57-d68b8a1490ab tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:55.242179 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3f36d13d-7307-40db-ab57-d68b8a1490ab tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:55.242942 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3f36d13d-7307-40db-ab57-d68b8a1490ab tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:55.243377 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3f36d13d-7307-40db-ab57-d68b8a1490ab tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:55.311537 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-10a9f8da-5436-4bd4-baad-443da5703454 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:55.312140 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-10a9f8da-5436-4bd4-baad-443da5703454 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:55.318102 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10a9f8da-5436-4bd4-baad-443da5703454 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:55.318544 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10a9f8da-5436-4bd4-baad-443da5703454 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:55.319316 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10a9f8da-5436-4bd4-baad-443da5703454 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:55.319746 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10a9f8da-5436-4bd4-baad-443da5703454 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:55.370056 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3f36d13d-7307-40db-ab57-d68b8a1490ab tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:55.377922 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3f36d13d-7307-40db-ab57-d68b8a1490ab tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:55.379451 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3f36d13d-7307-40db-ab57-d68b8a1490ab tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:55.380589 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3f36d13d-7307-40db-ab57-d68b8a1490ab tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1741 microversion: 2.20 time: 0.149978 Jan 05 15:01:55.381354 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 201/412] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:55 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1741 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:55.451523 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-10a9f8da-5436-4bd4-baad-443da5703454 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:55.458650 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-10a9f8da-5436-4bd4-baad-443da5703454 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.150789 Jan 05 15:01:55.459182 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 212/413] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:55 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:55.853560 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-34b79522-4229-4f03-bd5b-08dd415a1795 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:55.854157 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-34b79522-4229-4f03-bd5b-08dd415a1795 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:55.860627 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-34b79522-4229-4f03-bd5b-08dd415a1795 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:55.861088 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-34b79522-4229-4f03-bd5b-08dd415a1795 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:55.861882 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-34b79522-4229-4f03-bd5b-08dd415a1795 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:55.862315 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-34b79522-4229-4f03-bd5b-08dd415a1795 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:55.993803 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-34b79522-4229-4f03-bd5b-08dd415a1795 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:56.002015 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-34b79522-4229-4f03-bd5b-08dd415a1795 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.152026 Jan 05 15:01:56.002586 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 202/414] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:55 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:56.398378 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c3c94a76-d634-4d4c-a2ba-fb02264088ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:56.398994 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c3c94a76-d634-4d4c-a2ba-fb02264088ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:56.405272 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3c94a76-d634-4d4c-a2ba-fb02264088ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:56.405715 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3c94a76-d634-4d4c-a2ba-fb02264088ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:56.406476 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3c94a76-d634-4d4c-a2ba-fb02264088ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:56.406900 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3c94a76-d634-4d4c-a2ba-fb02264088ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:56.474991 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e9a99f70-c16c-43c1-8d91-f29c60094080 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:56.475700 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e9a99f70-c16c-43c1-8d91-f29c60094080 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:56.482704 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e9a99f70-c16c-43c1-8d91-f29c60094080 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:56.483159 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e9a99f70-c16c-43c1-8d91-f29c60094080 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:56.484761 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e9a99f70-c16c-43c1-8d91-f29c60094080 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:56.485227 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e9a99f70-c16c-43c1-8d91-f29c60094080 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:56.535106 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-c3c94a76-d634-4d4c-a2ba-fb02264088ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:56.543079 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-c3c94a76-d634-4d4c-a2ba-fb02264088ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:56.544618 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-c3c94a76-d634-4d4c-a2ba-fb02264088ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:56.546475 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c3c94a76-d634-4d4c-a2ba-fb02264088ea tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1741 microversion: 2.20 time: 0.151375 Jan 05 15:01:56.547037 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 213/415] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:56 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1741 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:56.620628 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e9a99f70-c16c-43c1-8d91-f29c60094080 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:56.628479 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e9a99f70-c16c-43c1-8d91-f29c60094080 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.157230 Jan 05 15:01:56.629142 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 203/416] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:56 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:57.018422 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-78ee8c89-cb19-4be5-b2c5-09a5ee9eb6fe tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:57.019030 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-78ee8c89-cb19-4be5-b2c5-09a5ee9eb6fe tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:57.025028 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78ee8c89-cb19-4be5-b2c5-09a5ee9eb6fe tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:57.025515 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78ee8c89-cb19-4be5-b2c5-09a5ee9eb6fe tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:57.026297 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78ee8c89-cb19-4be5-b2c5-09a5ee9eb6fe tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:57.026728 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78ee8c89-cb19-4be5-b2c5-09a5ee9eb6fe tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:57.160972 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-78ee8c89-cb19-4be5-b2c5-09a5ee9eb6fe tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:57.168930 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-78ee8c89-cb19-4be5-b2c5-09a5ee9eb6fe tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.154196 Jan 05 15:01:57.169521 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 214/417] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:57 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:57.564889 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-00f0491e-f832-442b-8d8c-fff69fa1fc01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:57.565474 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-00f0491e-f832-442b-8d8c-fff69fa1fc01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:57.571699 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-00f0491e-f832-442b-8d8c-fff69fa1fc01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:57.572142 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-00f0491e-f832-442b-8d8c-fff69fa1fc01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:57.572900 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-00f0491e-f832-442b-8d8c-fff69fa1fc01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:57.573350 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-00f0491e-f832-442b-8d8c-fff69fa1fc01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:57.645387 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2ae2c704-7d98-484d-8720-52f99ab8ca3e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:57.645993 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2ae2c704-7d98-484d-8720-52f99ab8ca3e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:57.652366 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ae2c704-7d98-484d-8720-52f99ab8ca3e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:57.652821 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ae2c704-7d98-484d-8720-52f99ab8ca3e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:57.653629 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ae2c704-7d98-484d-8720-52f99ab8ca3e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:57.654062 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ae2c704-7d98-484d-8720-52f99ab8ca3e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:57.701929 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-00f0491e-f832-442b-8d8c-fff69fa1fc01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:57.709628 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-00f0491e-f832-442b-8d8c-fff69fa1fc01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:57.711148 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-00f0491e-f832-442b-8d8c-fff69fa1fc01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:57.712290 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-00f0491e-f832-442b-8d8c-fff69fa1fc01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1741 microversion: 2.20 time: 0.151667 Jan 05 15:01:57.712850 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 204/418] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:57 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1741 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:57.783249 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-2ae2c704-7d98-484d-8720-52f99ab8ca3e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:57.790483 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2ae2c704-7d98-484d-8720-52f99ab8ca3e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.148796 Jan 05 15:01:57.791129 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 215/419] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:57 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:58.184677 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-20cb26b7-6e34-46b9-a106-8456ffa49202 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:58.185311 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-20cb26b7-6e34-46b9-a106-8456ffa49202 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:58.191114 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-20cb26b7-6e34-46b9-a106-8456ffa49202 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:58.191556 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-20cb26b7-6e34-46b9-a106-8456ffa49202 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:58.192319 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-20cb26b7-6e34-46b9-a106-8456ffa49202 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:58.192746 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-20cb26b7-6e34-46b9-a106-8456ffa49202 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:58.329931 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-20cb26b7-6e34-46b9-a106-8456ffa49202 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:58.338434 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-20cb26b7-6e34-46b9-a106-8456ffa49202 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.157367 Jan 05 15:01:58.339082 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 205/420] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:58 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:58.731491 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8fdc1bdc-f2cb-4849-9657-9a59721aa074 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:58.732273 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8fdc1bdc-f2cb-4849-9657-9a59721aa074 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:58.739545 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fdc1bdc-f2cb-4849-9657-9a59721aa074 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:58.740636 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fdc1bdc-f2cb-4849-9657-9a59721aa074 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:58.741134 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fdc1bdc-f2cb-4849-9657-9a59721aa074 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:58.741569 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fdc1bdc-f2cb-4849-9657-9a59721aa074 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:58.808983 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2a6b0561-ca65-49f4-81bb-065626b281ee tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:58.809659 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2a6b0561-ca65-49f4-81bb-065626b281ee tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:58.821052 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2a6b0561-ca65-49f4-81bb-065626b281ee tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:58.821761 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2a6b0561-ca65-49f4-81bb-065626b281ee tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:58.822705 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2a6b0561-ca65-49f4-81bb-065626b281ee tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:58.823295 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2a6b0561-ca65-49f4-81bb-065626b281ee tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:58.917796 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8fdc1bdc-f2cb-4849-9657-9a59721aa074 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:58.926735 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8fdc1bdc-f2cb-4849-9657-9a59721aa074 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:58.928272 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8fdc1bdc-f2cb-4849-9657-9a59721aa074 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:58.929455 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8fdc1bdc-f2cb-4849-9657-9a59721aa074 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1741 microversion: 2.20 time: 0.201952 Jan 05 15:01:58.933137 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 216/421] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:58 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:01:59.020105 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-2a6b0561-ca65-49f4-81bb-065626b281ee tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:59.030459 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2a6b0561-ca65-49f4-81bb-065626b281ee tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.225100 Jan 05 15:01:59.031418 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 206/422] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:58 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:01:59.359693 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4e5af71b-df71-4727-ba3d-aaf14209d5fb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:59.360349 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4e5af71b-df71-4727-ba3d-aaf14209d5fb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:59.366914 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e5af71b-df71-4727-ba3d-aaf14209d5fb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:59.367838 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e5af71b-df71-4727-ba3d-aaf14209d5fb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:59.369025 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e5af71b-df71-4727-ba3d-aaf14209d5fb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:59.369756 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e5af71b-df71-4727-ba3d-aaf14209d5fb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:59.511263 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4e5af71b-df71-4727-ba3d-aaf14209d5fb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:01:59.520780 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4e5af71b-df71-4727-ba3d-aaf14209d5fb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.167752 Jan 05 15:01:59.521629 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 217/423] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:01:59 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:01:59.949635 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b3b6a60b-cd4e-448b-8a1c-5d63cf81192f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:01:59.951085 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b3b6a60b-cd4e-448b-8a1c-5d63cf81192f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:01:59.959443 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b3b6a60b-cd4e-448b-8a1c-5d63cf81192f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:59.959903 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b3b6a60b-cd4e-448b-8a1c-5d63cf81192f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:01:59.961857 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b3b6a60b-cd4e-448b-8a1c-5d63cf81192f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:01:59.962325 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b3b6a60b-cd4e-448b-8a1c-5d63cf81192f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:00.050593 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cbaddc6d-b52f-4803-ad5a-7e198ddbab89 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:00.051833 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cbaddc6d-b52f-4803-ad5a-7e198ddbab89 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:00.058639 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbaddc6d-b52f-4803-ad5a-7e198ddbab89 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:00.059422 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbaddc6d-b52f-4803-ad5a-7e198ddbab89 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:00.060434 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbaddc6d-b52f-4803-ad5a-7e198ddbab89 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:00.061104 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbaddc6d-b52f-4803-ad5a-7e198ddbab89 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:00.211170 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b3b6a60b-cd4e-448b-8a1c-5d63cf81192f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:00.221925 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b3b6a60b-cd4e-448b-8a1c-5d63cf81192f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:00.223527 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b3b6a60b-cd4e-448b-8a1c-5d63cf81192f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:00.224700 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b3b6a60b-cd4e-448b-8a1c-5d63cf81192f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1741 microversion: 2.20 time: 0.278832 Jan 05 15:02:00.225274 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 207/424] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:01:59 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1741 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:00.230597 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-cbaddc6d-b52f-4803-ad5a-7e198ddbab89 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:00.239478 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cbaddc6d-b52f-4803-ad5a-7e198ddbab89 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.192840 Jan 05 15:02:00.248760 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 218/425] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:00 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:02:00.474410 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-f4163500-0c60-4f77-b6a9-603ce29eca9b req-ef21d3bf-f827-4373-926d-b59e67afb32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69165fdc-1854-4f3f-a46a-6727d1bf96bc", "name": "network-vif-plugged", "status": "completed", "tag": "32e7c026-6194-414c-8f67-f9b7c7e9a4d0"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:02:00.476519 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:00.476519 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:02:00.487224 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-f4163500-0c60-4f77-b6a9-603ce29eca9b req-ef21d3bf-f827-4373-926d-b59e67afb32a service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:00.489495 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-f4163500-0c60-4f77-b6a9-603ce29eca9b req-ef21d3bf-f827-4373-926d-b59e67afb32a service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:00.504960 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-f4163500-0c60-4f77-b6a9-603ce29eca9b req-ef21d3bf-f827-4373-926d-b59e67afb32a service nova] Creating event network-vif-plugged:32e7c026-6194-414c-8f67-f9b7c7e9a4d0 for instance 69165fdc-1854-4f3f-a46a-6727d1bf96bc on hv-cinder-maste Jan 05 15:02:00.510675 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-f4163500-0c60-4f77-b6a9-603ce29eca9b req-ef21d3bf-f827-4373-926d-b59e67afb32a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040639 Jan 05 15:02:00.511604 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 208/426] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:02:00.538484 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d2b0a723-354c-425c-aa56-0e5356895442 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:00.539257 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d2b0a723-354c-425c-aa56-0e5356895442 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:00.546153 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b0a723-354c-425c-aa56-0e5356895442 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:00.547614 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b0a723-354c-425c-aa56-0e5356895442 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:00.548856 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b0a723-354c-425c-aa56-0e5356895442 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:00.549591 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b0a723-354c-425c-aa56-0e5356895442 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:00.720239 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d2b0a723-354c-425c-aa56-0e5356895442 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:00.743814 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d2b0a723-354c-425c-aa56-0e5356895442 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.208996 Jan 05 15:02:00.745030 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 219/427] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:00 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:01.244102 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e4c137e5-5a9d-4a07-895b-7f515bf7102b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:01.245462 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e4c137e5-5a9d-4a07-895b-7f515bf7102b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:01.260395 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-29d40936-4bc0-4031-90d7-1b1e41947a2e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:01.262332 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-29d40936-4bc0-4031-90d7-1b1e41947a2e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:01.283316 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29d40936-4bc0-4031-90d7-1b1e41947a2e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:01.283762 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29d40936-4bc0-4031-90d7-1b1e41947a2e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:01.284558 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29d40936-4bc0-4031-90d7-1b1e41947a2e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:01.284986 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29d40936-4bc0-4031-90d7-1b1e41947a2e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:01.289318 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e4c137e5-5a9d-4a07-895b-7f515bf7102b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:01.289766 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e4c137e5-5a9d-4a07-895b-7f515bf7102b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:01.292173 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e4c137e5-5a9d-4a07-895b-7f515bf7102b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:01.294115 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e4c137e5-5a9d-4a07-895b-7f515bf7102b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:01.478308 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-29d40936-4bc0-4031-90d7-1b1e41947a2e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:01.487098 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-29d40936-4bc0-4031-90d7-1b1e41947a2e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.233054 Jan 05 15:02:01.489781 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 220/428] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:01 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:01.542510 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e4c137e5-5a9d-4a07-895b-7f515bf7102b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:01.555320 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e4c137e5-5a9d-4a07-895b-7f515bf7102b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:01.556962 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e4c137e5-5a9d-4a07-895b-7f515bf7102b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:01.558260 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e4c137e5-5a9d-4a07-895b-7f515bf7102b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1741 microversion: 2.20 time: 0.318409 Jan 05 15:02:01.558921 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 209/429] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:01 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1741 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:01.760496 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-646067bd-0594-495e-81da-f0b5b246c06f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:01.761127 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-646067bd-0594-495e-81da-f0b5b246c06f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:01.766947 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-646067bd-0594-495e-81da-f0b5b246c06f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:01.767465 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-646067bd-0594-495e-81da-f0b5b246c06f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:01.768240 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-646067bd-0594-495e-81da-f0b5b246c06f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:01.768664 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-646067bd-0594-495e-81da-f0b5b246c06f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:01.910386 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-646067bd-0594-495e-81da-f0b5b246c06f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:01.918017 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-646067bd-0594-495e-81da-f0b5b246c06f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.161356 Jan 05 15:02:01.918573 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 221/430] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:01 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:02.506989 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-4fc28f08-21f1-4fa6-961c-5c10e502d778 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:02.508537 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-4fc28f08-21f1-4fa6-961c-5c10e502d778 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:02.516317 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4fc28f08-21f1-4fa6-961c-5c10e502d778 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:02.517266 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4fc28f08-21f1-4fa6-961c-5c10e502d778 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:02.518547 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4fc28f08-21f1-4fa6-961c-5c10e502d778 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:02.519147 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4fc28f08-21f1-4fa6-961c-5c10e502d778 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:02.577329 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f17896a9-5556-4641-846e-057a894cb5e9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:02.578659 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f17896a9-5556-4641-846e-057a894cb5e9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:02.596738 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f17896a9-5556-4641-846e-057a894cb5e9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:02.597230 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f17896a9-5556-4641-846e-057a894cb5e9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:02.598099 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f17896a9-5556-4641-846e-057a894cb5e9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:02.598612 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f17896a9-5556-4641-846e-057a894cb5e9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:02.702179 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-4fc28f08-21f1-4fa6-961c-5c10e502d778 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:02.711688 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-4fc28f08-21f1-4fa6-961c-5c10e502d778 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.209178 Jan 05 15:02:02.712289 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 210/431] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:02 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:02.820316 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-f17896a9-5556-4641-846e-057a894cb5e9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:02.828554 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-f17896a9-5556-4641-846e-057a894cb5e9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:02.830104 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-f17896a9-5556-4641-846e-057a894cb5e9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:02.831464 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f17896a9-5556-4641-846e-057a894cb5e9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1741 microversion: 2.20 time: 0.257568 Jan 05 15:02:02.831843 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 222/432] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:02 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1741 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:02.934927 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ecb74611-e6f2-45f9-8862-8582553bab86 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:02.935819 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ecb74611-e6f2-45f9-8862-8582553bab86 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:02.942631 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ecb74611-e6f2-45f9-8862-8582553bab86 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:02.943108 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ecb74611-e6f2-45f9-8862-8582553bab86 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:02.943900 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ecb74611-e6f2-45f9-8862-8582553bab86 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:02.944336 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ecb74611-e6f2-45f9-8862-8582553bab86 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:03.092670 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ecb74611-e6f2-45f9-8862-8582553bab86 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:03.109622 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ecb74611-e6f2-45f9-8862-8582553bab86 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.177636 Jan 05 15:02:03.110488 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 211/433] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:02 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:02:03.731137 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1926164-def1-4a9d-9e12-c2d9b978ad0e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:03.732476 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f1926164-def1-4a9d-9e12-c2d9b978ad0e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:03.739693 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1926164-def1-4a9d-9e12-c2d9b978ad0e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:03.740349 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1926164-def1-4a9d-9e12-c2d9b978ad0e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:03.741145 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1926164-def1-4a9d-9e12-c2d9b978ad0e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:03.741568 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1926164-def1-4a9d-9e12-c2d9b978ad0e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:03.850731 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c1e5d9a1-329a-48d9-ac22-b145856c7e7d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:03.854751 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c1e5d9a1-329a-48d9-ac22-b145856c7e7d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:03.863731 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c1e5d9a1-329a-48d9-ac22-b145856c7e7d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:03.864588 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c1e5d9a1-329a-48d9-ac22-b145856c7e7d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:03.865600 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c1e5d9a1-329a-48d9-ac22-b145856c7e7d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:03.866386 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c1e5d9a1-329a-48d9-ac22-b145856c7e7d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:03.898337 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-f1926164-def1-4a9d-9e12-c2d9b978ad0e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:03.905233 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f1926164-def1-4a9d-9e12-c2d9b978ad0e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.178773 Jan 05 15:02:03.907660 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 223/434] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:03 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:04.043964 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c1e5d9a1-329a-48d9-ac22-b145856c7e7d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:04.053495 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c1e5d9a1-329a-48d9-ac22-b145856c7e7d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:04.055084 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c1e5d9a1-329a-48d9-ac22-b145856c7e7d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:04.056236 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c1e5d9a1-329a-48d9-ac22-b145856c7e7d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1741 microversion: 2.20 time: 0.209360 Jan 05 15:02:04.056795 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 212/435] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:03 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1741 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:04.130119 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e1dbf379-9885-466d-ac71-cb2fb5ba0fb2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:04.131882 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e1dbf379-9885-466d-ac71-cb2fb5ba0fb2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:04.138141 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1dbf379-9885-466d-ac71-cb2fb5ba0fb2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:04.138582 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1dbf379-9885-466d-ac71-cb2fb5ba0fb2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:04.139564 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1dbf379-9885-466d-ac71-cb2fb5ba0fb2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:04.140047 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1dbf379-9885-466d-ac71-cb2fb5ba0fb2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:04.287985 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e1dbf379-9885-466d-ac71-cb2fb5ba0fb2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:04.296847 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e1dbf379-9885-466d-ac71-cb2fb5ba0fb2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.173220 Jan 05 15:02:04.306357 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 224/436] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:04 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:04.923671 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-63207503-f5e3-4e8d-b9ab-99e4bb379225 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:04.924476 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-63207503-f5e3-4e8d-b9ab-99e4bb379225 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:04.931178 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-63207503-f5e3-4e8d-b9ab-99e4bb379225 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:04.931625 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-63207503-f5e3-4e8d-b9ab-99e4bb379225 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:04.932414 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-63207503-f5e3-4e8d-b9ab-99e4bb379225 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:04.932844 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-63207503-f5e3-4e8d-b9ab-99e4bb379225 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:05.075638 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-380bc4a6-4c12-4d9c-aabe-b53bfac1d9e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:05.076273 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-380bc4a6-4c12-4d9c-aabe-b53bfac1d9e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:05.081266 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-63207503-f5e3-4e8d-b9ab-99e4bb379225 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:05.082530 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-380bc4a6-4c12-4d9c-aabe-b53bfac1d9e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:05.082960 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-380bc4a6-4c12-4d9c-aabe-b53bfac1d9e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:05.083741 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-380bc4a6-4c12-4d9c-aabe-b53bfac1d9e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:05.084169 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-380bc4a6-4c12-4d9c-aabe-b53bfac1d9e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:05.089319 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-63207503-f5e3-4e8d-b9ab-99e4bb379225 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1313 microversion: 2.1 time: 0.169829 Jan 05 15:02:05.090155 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 213/437] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:04 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:05.221443 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-380bc4a6-4c12-4d9c-aabe-b53bfac1d9e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:05.230517 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-380bc4a6-4c12-4d9c-aabe-b53bfac1d9e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:05.231927 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-380bc4a6-4c12-4d9c-aabe-b53bfac1d9e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:05.233102 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-380bc4a6-4c12-4d9c-aabe-b53bfac1d9e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1741 microversion: 2.20 time: 0.161248 Jan 05 15:02:05.234541 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 225/438] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:05 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:02:05.313088 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6e2df7d6-a4fb-4659-bcea-bff9a691d23b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:05.313709 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-6e2df7d6-a4fb-4659-bcea-bff9a691d23b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:05.319568 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6e2df7d6-a4fb-4659-bcea-bff9a691d23b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:05.320017 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6e2df7d6-a4fb-4659-bcea-bff9a691d23b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:05.320795 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6e2df7d6-a4fb-4659-bcea-bff9a691d23b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:05.321313 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6e2df7d6-a4fb-4659-bcea-bff9a691d23b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:05.455925 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-6e2df7d6-a4fb-4659-bcea-bff9a691d23b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:05.463845 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6e2df7d6-a4fb-4659-bcea-bff9a691d23b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.154376 Jan 05 15:02:05.465059 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 214/439] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:05 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:06.107009 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-00a2c1c0-d8e7-4b73-9af5-6b36ee1efdd7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:06.107617 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-00a2c1c0-d8e7-4b73-9af5-6b36ee1efdd7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:06.116428 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00a2c1c0-d8e7-4b73-9af5-6b36ee1efdd7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:06.117040 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00a2c1c0-d8e7-4b73-9af5-6b36ee1efdd7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:06.118034 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00a2c1c0-d8e7-4b73-9af5-6b36ee1efdd7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:06.118625 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00a2c1c0-d8e7-4b73-9af5-6b36ee1efdd7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:06.253254 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-578c6291-233d-4e57-bb2a-002f250c188c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:06.254039 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-578c6291-233d-4e57-bb2a-002f250c188c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:06.261164 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-578c6291-233d-4e57-bb2a-002f250c188c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:06.261741 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-578c6291-233d-4e57-bb2a-002f250c188c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:06.262625 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-578c6291-233d-4e57-bb2a-002f250c188c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:06.263159 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-578c6291-233d-4e57-bb2a-002f250c188c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:06.286149 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-00a2c1c0-d8e7-4b73-9af5-6b36ee1efdd7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:06.296894 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-00a2c1c0-d8e7-4b73-9af5-6b36ee1efdd7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1498 microversion: 2.1 time: 0.191597 Jan 05 15:02:06.303688 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 226/440] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:06 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1498 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:06.455009 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-578c6291-233d-4e57-bb2a-002f250c188c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:06.466858 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-578c6291-233d-4e57-bb2a-002f250c188c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:06.467410 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-578c6291-233d-4e57-bb2a-002f250c188c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:06.469145 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-578c6291-233d-4e57-bb2a-002f250c188c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1741 microversion: 2.20 time: 0.219676 Jan 05 15:02:06.469874 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 215/441] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:06 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1741 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:02:06.482011 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-760eb6f9-3cc2-46d9-8a1f-8d0c0a170296 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:06.482629 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-760eb6f9-3cc2-46d9-8a1f-8d0c0a170296 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:06.493561 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-760eb6f9-3cc2-46d9-8a1f-8d0c0a170296 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:06.503273 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-760eb6f9-3cc2-46d9-8a1f-8d0c0a170296 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:06.503273 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-760eb6f9-3cc2-46d9-8a1f-8d0c0a170296 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:06.503273 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-760eb6f9-3cc2-46d9-8a1f-8d0c0a170296 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:06.690889 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-760eb6f9-3cc2-46d9-8a1f-8d0c0a170296 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:06.698870 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-760eb6f9-3cc2-46d9-8a1f-8d0c0a170296 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.220689 Jan 05 15:02:06.699427 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 227/442] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:06 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:02:07.489878 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-37f2161c-d60d-4987-af9f-b5838b4422c4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:07.490517 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-37f2161c-d60d-4987-af9f-b5838b4422c4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:07.502030 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-37f2161c-d60d-4987-af9f-b5838b4422c4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:07.502489 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-37f2161c-d60d-4987-af9f-b5838b4422c4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:07.503300 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-37f2161c-d60d-4987-af9f-b5838b4422c4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:07.503722 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-37f2161c-d60d-4987-af9f-b5838b4422c4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:07.552808 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:07.553301 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:07.563479 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:07.563956 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:07.564773 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:07.567073 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:07.623368 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:02:07.745095 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-37f2161c-d60d-4987-af9f-b5838b4422c4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:07.762725 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-37f2161c-d60d-4987-af9f-b5838b4422c4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:07.764753 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-37f2161c-d60d-4987-af9f-b5838b4422c4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:07.770527 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-37f2161c-d60d-4987-af9f-b5838b4422c4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1741 microversion: 2.20 time: 0.284225 Jan 05 15:02:07.771193 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 216/443] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:07 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1741 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:02:07.788245 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c0d6c084-4f27-4a6f-a845-46db52ce2a67 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:07.788929 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c0d6c084-4f27-4a6f-a845-46db52ce2a67 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:07.795340 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c0d6c084-4f27-4a6f-a845-46db52ce2a67 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:07.795938 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c0d6c084-4f27-4a6f-a845-46db52ce2a67 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:07.797363 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c0d6c084-4f27-4a6f-a845-46db52ce2a67 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:07.797794 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c0d6c084-4f27-4a6f-a845-46db52ce2a67 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:08.005837 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c0d6c084-4f27-4a6f-a845-46db52ce2a67 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:08.017506 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c0d6c084-4f27-4a6f-a845-46db52ce2a67 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.230471 Jan 05 15:02:08.020404 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 217/444] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:07 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:08.146224 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "DELETE /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 204 len: 0 microversion: 2.1 time: 0.596882 Jan 05 15:02:08.147500 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 228/445] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:02:07 2022] DELETE /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 0 bytes in 599 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 05 15:02:08.157985 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-456b17ea-b375-4daa-89a5-6000728ad1e2 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:08.160275 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-456b17ea-b375-4daa-89a5-6000728ad1e2 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:08.166330 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-456b17ea-b375-4daa-89a5-6000728ad1e2 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:08.166775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-456b17ea-b375-4daa-89a5-6000728ad1e2 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:08.167703 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-456b17ea-b375-4daa-89a5-6000728ad1e2 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:08.168182 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-456b17ea-b375-4daa-89a5-6000728ad1e2 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:08.380614 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-456b17ea-b375-4daa-89a5-6000728ad1e2 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:08.400386 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-456b17ea-b375-4daa-89a5-6000728ad1e2 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1504 microversion: 2.1 time: 0.245660 Jan 05 15:02:08.410061 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 218/446] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:08 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:08.790271 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d17540fd-3597-4398-8422-7e61215357ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:08.790911 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d17540fd-3597-4398-8422-7e61215357ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:08.797791 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d17540fd-3597-4398-8422-7e61215357ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:08.829534 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d17540fd-3597-4398-8422-7e61215357ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:08.829534 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d17540fd-3597-4398-8422-7e61215357ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:08.829534 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d17540fd-3597-4398-8422-7e61215357ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:08.940134 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d17540fd-3597-4398-8422-7e61215357ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:08.948451 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d17540fd-3597-4398-8422-7e61215357ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:08.950124 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d17540fd-3597-4398-8422-7e61215357ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:08.951334 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d17540fd-3597-4398-8422-7e61215357ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1741 microversion: 2.20 time: 0.165308 Jan 05 15:02:08.951895 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 229/447] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:08 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:09.039726 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c5769613-95d7-4d31-95b4-b910b0074e3c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:09.040588 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c5769613-95d7-4d31-95b4-b910b0074e3c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:09.047607 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c5769613-95d7-4d31-95b4-b910b0074e3c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:09.048065 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c5769613-95d7-4d31-95b4-b910b0074e3c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:09.048855 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c5769613-95d7-4d31-95b4-b910b0074e3c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:09.049314 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c5769613-95d7-4d31-95b4-b910b0074e3c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:09.182073 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c5769613-95d7-4d31-95b4-b910b0074e3c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:09.189834 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c5769613-95d7-4d31-95b4-b910b0074e3c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.153836 Jan 05 15:02:09.190397 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 219/448] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:09 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:09.422983 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1dbb14ae-534f-4638-89a1-3e5e8404ef8b tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:09.423587 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1dbb14ae-534f-4638-89a1-3e5e8404ef8b tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:09.429544 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1dbb14ae-534f-4638-89a1-3e5e8404ef8b tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:09.429982 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1dbb14ae-534f-4638-89a1-3e5e8404ef8b tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:09.430746 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1dbb14ae-534f-4638-89a1-3e5e8404ef8b tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:09.431168 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1dbb14ae-534f-4638-89a1-3e5e8404ef8b tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:09.567953 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1dbb14ae-534f-4638-89a1-3e5e8404ef8b tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:09.575913 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1dbb14ae-534f-4638-89a1-3e5e8404ef8b tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1504 microversion: 2.1 time: 0.161878 Jan 05 15:02:09.576713 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 230/449] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:09 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:09.973128 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e34394f7-6790-406f-8b5d-09525e39725d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:09.973950 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e34394f7-6790-406f-8b5d-09525e39725d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:09.980269 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e34394f7-6790-406f-8b5d-09525e39725d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:09.980837 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e34394f7-6790-406f-8b5d-09525e39725d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:09.981767 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e34394f7-6790-406f-8b5d-09525e39725d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:09.982308 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e34394f7-6790-406f-8b5d-09525e39725d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:10.127594 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e34394f7-6790-406f-8b5d-09525e39725d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:10.138648 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e34394f7-6790-406f-8b5d-09525e39725d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:10.140632 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e34394f7-6790-406f-8b5d-09525e39725d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:10.142009 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e34394f7-6790-406f-8b5d-09525e39725d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1741 microversion: 2.20 time: 0.172601 Jan 05 15:02:10.152885 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 220/450] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:09 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:10.208172 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b923d63e-a4a1-41bc-ac98-afa929c499ae tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:10.209118 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b923d63e-a4a1-41bc-ac98-afa929c499ae tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:10.218125 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b923d63e-a4a1-41bc-ac98-afa929c499ae tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:10.219523 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b923d63e-a4a1-41bc-ac98-afa929c499ae tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:10.220367 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b923d63e-a4a1-41bc-ac98-afa929c499ae tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:10.220945 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b923d63e-a4a1-41bc-ac98-afa929c499ae tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:10.395380 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b923d63e-a4a1-41bc-ac98-afa929c499ae tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:10.403051 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b923d63e-a4a1-41bc-ac98-afa929c499ae tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.199997 Jan 05 15:02:10.403620 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 231/451] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:10 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:10.592964 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-62d3cb41-5fc7-4247-a3f4-c519aa9dec82 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:10.593605 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-62d3cb41-5fc7-4247-a3f4-c519aa9dec82 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:10.599526 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-62d3cb41-5fc7-4247-a3f4-c519aa9dec82 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:10.599976 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-62d3cb41-5fc7-4247-a3f4-c519aa9dec82 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:10.600788 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-62d3cb41-5fc7-4247-a3f4-c519aa9dec82 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:10.601270 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-62d3cb41-5fc7-4247-a3f4-c519aa9dec82 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:10.747400 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-62d3cb41-5fc7-4247-a3f4-c519aa9dec82 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:10.758335 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-62d3cb41-5fc7-4247-a3f4-c519aa9dec82 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1504 microversion: 2.1 time: 0.167531 Jan 05 15:02:10.758335 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 221/452] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:10 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:11.160212 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-354e65bc-df80-4a35-a3df-c5c550be4abf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:11.160807 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-354e65bc-df80-4a35-a3df-c5c550be4abf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:11.166653 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-354e65bc-df80-4a35-a3df-c5c550be4abf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:11.167088 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-354e65bc-df80-4a35-a3df-c5c550be4abf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:11.167849 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-354e65bc-df80-4a35-a3df-c5c550be4abf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:11.168271 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-354e65bc-df80-4a35-a3df-c5c550be4abf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:11.306535 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-354e65bc-df80-4a35-a3df-c5c550be4abf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:11.315486 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-354e65bc-df80-4a35-a3df-c5c550be4abf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:11.317274 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-354e65bc-df80-4a35-a3df-c5c550be4abf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:11.318227 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-354e65bc-df80-4a35-a3df-c5c550be4abf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1741 microversion: 2.20 time: 0.162426 Jan 05 15:02:11.318782 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 232/453] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:11 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:11.419511 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-19f731a6-d34e-4e5a-bd22-34579c158c12 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:11.420427 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-19f731a6-d34e-4e5a-bd22-34579c158c12 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:11.427032 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-19f731a6-d34e-4e5a-bd22-34579c158c12 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:11.427485 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-19f731a6-d34e-4e5a-bd22-34579c158c12 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:11.428394 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-19f731a6-d34e-4e5a-bd22-34579c158c12 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:11.428836 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-19f731a6-d34e-4e5a-bd22-34579c158c12 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:11.565015 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-19f731a6-d34e-4e5a-bd22-34579c158c12 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:11.573797 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-19f731a6-d34e-4e5a-bd22-34579c158c12 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.157915 Jan 05 15:02:11.578589 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 222/454] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:11 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:11.773770 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d47257e1-820d-4a7f-bc77-81edb96035b6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:11.774460 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d47257e1-820d-4a7f-bc77-81edb96035b6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:11.780331 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d47257e1-820d-4a7f-bc77-81edb96035b6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:11.780854 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d47257e1-820d-4a7f-bc77-81edb96035b6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:11.782249 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d47257e1-820d-4a7f-bc77-81edb96035b6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:11.782747 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d47257e1-820d-4a7f-bc77-81edb96035b6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:11.924383 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d47257e1-820d-4a7f-bc77-81edb96035b6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:11.932726 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d47257e1-820d-4a7f-bc77-81edb96035b6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1504 microversion: 2.1 time: 0.162482 Jan 05 15:02:11.934373 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 233/455] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:11 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:12.337641 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-4e2a7933-a835-4221-85ae-3ef44ac18ac1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:12.338358 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-4e2a7933-a835-4221-85ae-3ef44ac18ac1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:12.345479 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4e2a7933-a835-4221-85ae-3ef44ac18ac1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:12.346110 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4e2a7933-a835-4221-85ae-3ef44ac18ac1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:12.347011 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4e2a7933-a835-4221-85ae-3ef44ac18ac1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:12.347552 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4e2a7933-a835-4221-85ae-3ef44ac18ac1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:12.518841 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-4e2a7933-a835-4221-85ae-3ef44ac18ac1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:12.527526 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-4e2a7933-a835-4221-85ae-3ef44ac18ac1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:12.529195 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-4e2a7933-a835-4221-85ae-3ef44ac18ac1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:12.530571 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-4e2a7933-a835-4221-85ae-3ef44ac18ac1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1741 microversion: 2.20 time: 0.197177 Jan 05 15:02:12.531954 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 223/456] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:12 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:12.596972 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7cf69ea1-dcf1-4a8b-8072-885e77096410 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:12.597852 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7cf69ea1-dcf1-4a8b-8072-885e77096410 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:12.613129 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cf69ea1-dcf1-4a8b-8072-885e77096410 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:12.613967 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cf69ea1-dcf1-4a8b-8072-885e77096410 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:12.615898 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cf69ea1-dcf1-4a8b-8072-885e77096410 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:12.616503 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cf69ea1-dcf1-4a8b-8072-885e77096410 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:12.768306 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-7cf69ea1-dcf1-4a8b-8072-885e77096410 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:12.776800 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7cf69ea1-dcf1-4a8b-8072-885e77096410 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.186973 Jan 05 15:02:12.777616 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 234/457] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:12 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:12.950331 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-939ab1b2-1981-4b00-8e5f-978ff2ea2a31 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:12.950976 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-939ab1b2-1981-4b00-8e5f-978ff2ea2a31 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:12.966649 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-939ab1b2-1981-4b00-8e5f-978ff2ea2a31 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:12.967563 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-939ab1b2-1981-4b00-8e5f-978ff2ea2a31 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:12.968582 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-939ab1b2-1981-4b00-8e5f-978ff2ea2a31 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:12.969792 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-939ab1b2-1981-4b00-8e5f-978ff2ea2a31 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:13.408966 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-939ab1b2-1981-4b00-8e5f-978ff2ea2a31 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:13.422548 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-939ab1b2-1981-4b00-8e5f-978ff2ea2a31 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1504 microversion: 2.1 time: 0.476351 Jan 05 15:02:13.424247 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 224/458] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:12 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:13.551167 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f1b235e-d23e-4b5b-a48c-0a376e903ffa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:13.552323 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8f1b235e-d23e-4b5b-a48c-0a376e903ffa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:13.565568 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f1b235e-d23e-4b5b-a48c-0a376e903ffa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:13.568216 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f1b235e-d23e-4b5b-a48c-0a376e903ffa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:13.572738 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f1b235e-d23e-4b5b-a48c-0a376e903ffa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:13.574321 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f1b235e-d23e-4b5b-a48c-0a376e903ffa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:13.685309 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-d8258bf7-1072-4416-a861-b764beeda858 req-9339c64e-551a-4b4b-81e4-a82bfbb7c4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69165fdc-1854-4f3f-a46a-6727d1bf96bc", "name": "network-vif-deleted", "tag": "32e7c026-6194-414c-8f67-f9b7c7e9a4d0"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:02:13.687266 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:13.687266 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:02:13.697220 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-d8258bf7-1072-4416-a861-b764beeda858 req-9339c64e-551a-4b4b-81e4-a82bfbb7c4ba service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:13.697220 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-d8258bf7-1072-4416-a861-b764beeda858 req-9339c64e-551a-4b4b-81e4-a82bfbb7c4ba service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:13.708982 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-d8258bf7-1072-4416-a861-b764beeda858 req-9339c64e-551a-4b4b-81e4-a82bfbb7c4ba service nova] Creating event network-vif-deleted:32e7c026-6194-414c-8f67-f9b7c7e9a4d0 for instance 69165fdc-1854-4f3f-a46a-6727d1bf96bc on hv-cinder-maste Jan 05 15:02:13.714302 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-d8258bf7-1072-4416-a861-b764beeda858 req-9339c64e-551a-4b4b-81e4-a82bfbb7c4ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033286 Jan 05 15:02:13.715162 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 225/459] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:02:13.797270 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3f93eaf5-f69b-4abf-87a0-a3049c1722f2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:13.799298 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3f93eaf5-f69b-4abf-87a0-a3049c1722f2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:13.815493 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3f93eaf5-f69b-4abf-87a0-a3049c1722f2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:13.817838 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3f93eaf5-f69b-4abf-87a0-a3049c1722f2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:13.824896 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3f93eaf5-f69b-4abf-87a0-a3049c1722f2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:13.825464 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3f93eaf5-f69b-4abf-87a0-a3049c1722f2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:14.014944 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8f1b235e-d23e-4b5b-a48c-0a376e903ffa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:14.023211 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8f1b235e-d23e-4b5b-a48c-0a376e903ffa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:14.035159 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8f1b235e-d23e-4b5b-a48c-0a376e903ffa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:14.036756 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8f1b235e-d23e-4b5b-a48c-0a376e903ffa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1723 microversion: 2.20 time: 0.490201 Jan 05 15:02:14.037560 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 235/460] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:13 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1723 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:14.089318 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3f93eaf5-f69b-4abf-87a0-a3049c1722f2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:14.100847 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3f93eaf5-f69b-4abf-87a0-a3049c1722f2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.309825 Jan 05 15:02:14.101794 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 226/461] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:13 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:14.439224 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1fc44412-fcae-4182-b796-0784552ae8f7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:14.439826 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1fc44412-fcae-4182-b796-0784552ae8f7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:14.445596 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fc44412-fcae-4182-b796-0784552ae8f7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:14.446049 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fc44412-fcae-4182-b796-0784552ae8f7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:14.446853 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fc44412-fcae-4182-b796-0784552ae8f7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:14.447288 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fc44412-fcae-4182-b796-0784552ae8f7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:14.477491 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fc44412-fcae-4182-b796-0784552ae8f7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:14.477847 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fc44412-fcae-4182-b796-0784552ae8f7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:14.478296 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-1fc44412-fcae-4182-b796-0784552ae8f7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lazy-loading 'fault' on Instance uuid 69165fdc-1854-4f3f-a46a-6727d1bf96bc {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:02:14.535201 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1fc44412-fcae-4182-b796-0784552ae8f7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0669d8dce2d64715948615519bf0eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e785ec07120a4184acdbf74f73489ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:14.545900 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1fc44412-fcae-4182-b796-0784552ae8f7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 200 len: 1303 microversion: 2.1 time: 0.110299 Jan 05 15:02:14.546482 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 236/462] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:14 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:15.057427 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-0e248c40-533a-4949-bef3-8134235e16f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:15.059034 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0e248c40-533a-4949-bef3-8134235e16f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:15.066112 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0e248c40-533a-4949-bef3-8134235e16f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:15.066563 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0e248c40-533a-4949-bef3-8134235e16f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:15.067337 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0e248c40-533a-4949-bef3-8134235e16f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:15.067927 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0e248c40-533a-4949-bef3-8134235e16f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:15.118605 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-03f47e6e-ee87-414a-8e74-be70968e5155 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:15.119215 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-03f47e6e-ee87-414a-8e74-be70968e5155 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:15.126953 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03f47e6e-ee87-414a-8e74-be70968e5155 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:15.127631 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03f47e6e-ee87-414a-8e74-be70968e5155 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:15.128673 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03f47e6e-ee87-414a-8e74-be70968e5155 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:15.141235 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03f47e6e-ee87-414a-8e74-be70968e5155 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:15.279022 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-03f47e6e-ee87-414a-8e74-be70968e5155 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:15.297553 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-0e248c40-533a-4949-bef3-8134235e16f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:15.297725 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-03f47e6e-ee87-414a-8e74-be70968e5155 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1567 microversion: 2.1 time: 0.172482 Jan 05 15:02:15.297725 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 237/463] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:15 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:02:15.297912 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-0e248c40-533a-4949-bef3-8134235e16f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:15.297912 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-0e248c40-533a-4949-bef3-8134235e16f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:15.297912 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-0e248c40-533a-4949-bef3-8134235e16f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1723 microversion: 2.20 time: 0.238553 Jan 05 15:02:15.298170 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 227/464] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:15 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:15.585365 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-810b9afe-9fb9-4877-bc8e-5976421b6e86 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:15.585996 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-810b9afe-9fb9-4877-bc8e-5976421b6e86 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] [instance: 69165fdc-1854-4f3f-a46a-6727d1bf96bc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:15.603387 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-810b9afe-9fb9-4877-bc8e-5976421b6e86 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:15.604405 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-810b9afe-9fb9-4877-bc8e-5976421b6e86 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:15.605585 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-810b9afe-9fb9-4877-bc8e-5976421b6e86 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:15.606023 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-810b9afe-9fb9-4877-bc8e-5976421b6e86 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:15.620750 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-810b9afe-9fb9-4877-bc8e-5976421b6e86 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] HTTP exception thrown: Instance 69165fdc-1854-4f3f-a46a-6727d1bf96bc could not be found. Jan 05 15:02:15.621321 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-810b9afe-9fb9-4877-bc8e-5976421b6e86 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Returning 404 to user: Instance 69165fdc-1854-4f3f-a46a-6727d1bf96bc could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:02:15.622153 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-810b9afe-9fb9-4877-bc8e-5976421b6e86 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc" status: 404 len: 111 microversion: 2.1 time: 0.048888 Jan 05 15:02:15.626236 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 238/465] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:15 2022] GET /compute/v2.1/servers/69165fdc-1854-4f3f-a46a-6727d1bf96bc => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:02:16.293925 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-5880b4ac-5f8c-4a1d-9c15-c3bb0c4a40ec req-79dba2c1-c9e3-44c8-a00a-4797f5daf1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "name": "network-vif-unplugged", "status": "completed", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:02:16.299052 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:16.299052 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:02:16.306215 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7c2fc8de-3ddb-4044-bcf1-01a49fa71739 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:16.306833 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7c2fc8de-3ddb-4044-bcf1-01a49fa71739 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:16.308683 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-5880b4ac-5f8c-4a1d-9c15-c3bb0c4a40ec req-79dba2c1-c9e3-44c8-a00a-4797f5daf1fd service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:16.310046 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-5880b4ac-5f8c-4a1d-9c15-c3bb0c4a40ec req-79dba2c1-c9e3-44c8-a00a-4797f5daf1fd service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:16.315706 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c2fc8de-3ddb-4044-bcf1-01a49fa71739 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:16.316162 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c2fc8de-3ddb-4044-bcf1-01a49fa71739 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:16.316959 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c2fc8de-3ddb-4044-bcf1-01a49fa71739 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:16.317415 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c2fc8de-3ddb-4044-bcf1-01a49fa71739 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:16.324757 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-5880b4ac-5f8c-4a1d-9c15-c3bb0c4a40ec req-79dba2c1-c9e3-44c8-a00a-4797f5daf1fd service nova] Creating event network-vif-unplugged:45483c3c-9f42-4aff-a962-22ff36647afc for instance 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 on hv-cinder-maste Jan 05 15:02:16.331374 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-5880b4ac-5f8c-4a1d-9c15-c3bb0c4a40ec req-79dba2c1-c9e3-44c8-a00a-4797f5daf1fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047733 Jan 05 15:02:16.332205 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 228/466] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:02:16.338988 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-82f75b99-84e9-4b92-94a6-c59f80add354 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:16.339678 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-82f75b99-84e9-4b92-94a6-c59f80add354 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:16.357408 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-82f75b99-84e9-4b92-94a6-c59f80add354 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:16.362115 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-82f75b99-84e9-4b92-94a6-c59f80add354 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:16.362115 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-82f75b99-84e9-4b92-94a6-c59f80add354 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:16.362115 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-82f75b99-84e9-4b92-94a6-c59f80add354 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:16.502423 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-7c2fc8de-3ddb-4044-bcf1-01a49fa71739 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:16.524366 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7c2fc8de-3ddb-4044-bcf1-01a49fa71739 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1547 microversion: 2.1 time: 0.223525 Jan 05 15:02:16.525243 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 239/467] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:16 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1547 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:02:16.551074 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e517acda-20df-4308-a4df-dac4ab1ab6d6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:16.552085 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e517acda-20df-4308-a4df-dac4ab1ab6d6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:16.572770 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e517acda-20df-4308-a4df-dac4ab1ab6d6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:16.574655 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e517acda-20df-4308-a4df-dac4ab1ab6d6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:16.581296 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e517acda-20df-4308-a4df-dac4ab1ab6d6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:16.587536 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e517acda-20df-4308-a4df-dac4ab1ab6d6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:16.782808 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-82f75b99-84e9-4b92-94a6-c59f80add354 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:16.795910 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-82f75b99-84e9-4b92-94a6-c59f80add354 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:16.799567 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-e517acda-20df-4308-a4df-dac4ab1ab6d6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] HTTP exception thrown: Cannot 'detach_volume' instance 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb while it is in vm_state rescued Jan 05 15:02:16.800471 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e517acda-20df-4308-a4df-dac4ab1ab6d6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Returning 409 to user: Cannot 'detach_volume' instance 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb while it is in vm_state rescued {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:02:16.801759 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-82f75b99-84e9-4b92-94a6-c59f80add354 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:16.804233 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-82f75b99-84e9-4b92-94a6-c59f80add354 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1723 microversion: 2.20 time: 0.470553 Jan 05 15:02:16.804502 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e517acda-20df-4308-a4df-dac4ab1ab6d6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/os-volume_attachments/707a1b94-49a8-4177-9aa3-2f4feadcbc10" status: 409 len: 152 microversion: 2.1 time: 0.261827 Jan 05 15:02:16.805602 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 240/468] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Jan 5 15:02:16 2022] DELETE /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/os-volume_attachments/707a1b94-49a8-4177-9aa3-2f4feadcbc10 => generated 152 bytes in 265 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 05 15:02:16.806290 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 229/469] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:16 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1723 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:16.823024 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-37e788a1-a6f2-4816-b9bd-0f99b154944b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:02:16.823695 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-37e788a1-a6f2-4816-b9bd-0f99b154944b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:16.836894 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37e788a1-a6f2-4816-b9bd-0f99b154944b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:16.837376 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37e788a1-a6f2-4816-b9bd-0f99b154944b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:16.839344 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37e788a1-a6f2-4816-b9bd-0f99b154944b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:16.839344 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37e788a1-a6f2-4816-b9bd-0f99b154944b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:17.110867 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-37e788a1-a6f2-4816-b9bd-0f99b154944b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "POST /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/action" status: 202 len: 0 microversion: 2.1 time: 0.291656 Jan 05 15:02:17.117028 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 241/470] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:02:16 2022] POST /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:02:17.123641 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6ccb9c3a-b3be-46e4-8f9b-9952f449f387 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:17.124248 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-6ccb9c3a-b3be-46e4-8f9b-9952f449f387 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:17.131014 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6ccb9c3a-b3be-46e4-8f9b-9952f449f387 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:17.131837 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6ccb9c3a-b3be-46e4-8f9b-9952f449f387 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:17.132732 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6ccb9c3a-b3be-46e4-8f9b-9952f449f387 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:17.133327 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6ccb9c3a-b3be-46e4-8f9b-9952f449f387 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:17.279733 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-6ccb9c3a-b3be-46e4-8f9b-9952f449f387 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:17.288650 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6ccb9c3a-b3be-46e4-8f9b-9952f449f387 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1555 microversion: 2.1 time: 0.168587 Jan 05 15:02:17.289479 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 230/471] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:17 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:02:17.824667 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-73aeb956-9671-4da2-896d-d29a91c9640b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:17.825502 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-73aeb956-9671-4da2-896d-d29a91c9640b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:17.837897 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73aeb956-9671-4da2-896d-d29a91c9640b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:17.841589 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73aeb956-9671-4da2-896d-d29a91c9640b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:17.843378 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73aeb956-9671-4da2-896d-d29a91c9640b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:17.844096 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73aeb956-9671-4da2-896d-d29a91c9640b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:18.045433 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-73aeb956-9671-4da2-896d-d29a91c9640b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:18.070021 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-73aeb956-9671-4da2-896d-d29a91c9640b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:18.071756 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-73aeb956-9671-4da2-896d-d29a91c9640b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:18.072953 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-73aeb956-9671-4da2-896d-d29a91c9640b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1666 microversion: 2.20 time: 0.253050 Jan 05 15:02:18.075945 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 242/472] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:17 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1666 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:18.100375 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-22812500-757a-4894-acb9-e881e5bf2868 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9af779f5-e190-4380-b009-1bdb20a4182c"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:02:18.101452 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-22812500-757a-4894-acb9-e881e5bf2868 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:18.108459 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-22812500-757a-4894-acb9-e881e5bf2868 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:18.108913 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-22812500-757a-4894-acb9-e881e5bf2868 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:18.110260 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-22812500-757a-4894-acb9-e881e5bf2868 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:18.110862 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-22812500-757a-4894-acb9-e881e5bf2868 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:18.306048 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7071f29a-91f9-4432-bac7-5cc2c9367353 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:18.306939 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7071f29a-91f9-4432-bac7-5cc2c9367353 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:18.314400 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7071f29a-91f9-4432-bac7-5cc2c9367353 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:18.315195 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7071f29a-91f9-4432-bac7-5cc2c9367353 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:18.316328 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7071f29a-91f9-4432-bac7-5cc2c9367353 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:18.316992 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7071f29a-91f9-4432-bac7-5cc2c9367353 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:18.622162 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-7071f29a-91f9-4432-bac7-5cc2c9367353 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:18.631193 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7071f29a-91f9-4432-bac7-5cc2c9367353 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1555 microversion: 2.1 time: 0.328637 Jan 05 15:02:18.632377 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 243/473] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:18 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1555 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:19.657175 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e5b3985c-ebad-4ce0-9d32-513dffe17198 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:19.661966 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e5b3985c-ebad-4ce0-9d32-513dffe17198 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:19.683238 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5b3985c-ebad-4ce0-9d32-513dffe17198 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:19.683688 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5b3985c-ebad-4ce0-9d32-513dffe17198 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:19.684477 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5b3985c-ebad-4ce0-9d32-513dffe17198 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:19.684904 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5b3985c-ebad-4ce0-9d32-513dffe17198 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:19.853999 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-22812500-757a-4894-acb9-e881e5bf2868 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.757425 Jan 05 15:02:19.860961 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 231/474] 10.222.0.30 () {62 vars in 1363 bytes} [Wed Jan 5 15:02:18 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments => generated 188 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:02:19.915691 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e5b3985c-ebad-4ce0-9d32-513dffe17198 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:19.934477 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e5b3985c-ebad-4ce0-9d32-513dffe17198 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1555 microversion: 2.1 time: 0.287061 Jan 05 15:02:19.935073 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 244/475] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:19 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1555 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:20.041108 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b324be6e-c11e-4232-bed9-a91b7b8be80d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:02:20.041668 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b324be6e-c11e-4232-bed9-a91b7b8be80d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:20.049274 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b324be6e-c11e-4232-bed9-a91b7b8be80d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:20.049725 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b324be6e-c11e-4232-bed9-a91b7b8be80d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:20.050525 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b324be6e-c11e-4232-bed9-a91b7b8be80d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:20.050961 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b324be6e-c11e-4232-bed9-a91b7b8be80d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:20.388589 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b324be6e-c11e-4232-bed9-a91b7b8be80d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action" status: 202 len: 0 microversion: 2.20 time: 0.351681 Jan 05 15:02:20.389795 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 232/476] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:02:20 2022] POST /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:02:20.398086 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-42f9e500-d6d0-4044-84f2-13a69ca6d994 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:20.399015 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-42f9e500-d6d0-4044-84f2-13a69ca6d994 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:20.407313 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42f9e500-d6d0-4044-84f2-13a69ca6d994 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:20.413027 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42f9e500-d6d0-4044-84f2-13a69ca6d994 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:20.414214 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42f9e500-d6d0-4044-84f2-13a69ca6d994 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:20.414846 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42f9e500-d6d0-4044-84f2-13a69ca6d994 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:20.664440 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-42f9e500-d6d0-4044-84f2-13a69ca6d994 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:20.675822 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-42f9e500-d6d0-4044-84f2-13a69ca6d994 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:20.677680 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-42f9e500-d6d0-4044-84f2-13a69ca6d994 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:20.680323 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-42f9e500-d6d0-4044-84f2-13a69ca6d994 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1752 microversion: 2.20 time: 0.286148 Jan 05 15:02:20.691280 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 245/477] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:20 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1752 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:20.959179 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-5982e8ec-7ce1-45f3-a152-0a9d08b3705b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:20.961494 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-5982e8ec-7ce1-45f3-a152-0a9d08b3705b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:20.968519 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5982e8ec-7ce1-45f3-a152-0a9d08b3705b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:20.969268 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5982e8ec-7ce1-45f3-a152-0a9d08b3705b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:20.970083 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5982e8ec-7ce1-45f3-a152-0a9d08b3705b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:20.970506 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5982e8ec-7ce1-45f3-a152-0a9d08b3705b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:21.185847 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-5982e8ec-7ce1-45f3-a152-0a9d08b3705b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:21.196990 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-5982e8ec-7ce1-45f3-a152-0a9d08b3705b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1555 microversion: 2.1 time: 0.247870 Jan 05 15:02:21.198790 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 233/478] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:20 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1555 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:21.698718 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1e370222-6b09-4a6c-b26d-d401d0f6c746 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:21.700569 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1e370222-6b09-4a6c-b26d-d401d0f6c746 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:21.707325 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e370222-6b09-4a6c-b26d-d401d0f6c746 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:21.708068 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e370222-6b09-4a6c-b26d-d401d0f6c746 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:21.709116 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e370222-6b09-4a6c-b26d-d401d0f6c746 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:21.710291 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e370222-6b09-4a6c-b26d-d401d0f6c746 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:21.918837 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e370222-6b09-4a6c-b26d-d401d0f6c746 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:21.956350 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e370222-6b09-4a6c-b26d-d401d0f6c746 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:21.958345 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e370222-6b09-4a6c-b26d-d401d0f6c746 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:21.972775 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1e370222-6b09-4a6c-b26d-d401d0f6c746 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1752 microversion: 2.20 time: 0.266264 Jan 05 15:02:21.978055 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 246/479] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:21 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1752 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:22.214820 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7cfe8de4-5f2b-4355-9d66-668d3c56ab8e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:22.216618 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7cfe8de4-5f2b-4355-9d66-668d3c56ab8e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:22.276658 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7cfe8de4-5f2b-4355-9d66-668d3c56ab8e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:22.297242 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7cfe8de4-5f2b-4355-9d66-668d3c56ab8e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:22.298825 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7cfe8de4-5f2b-4355-9d66-668d3c56ab8e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:22.303437 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7cfe8de4-5f2b-4355-9d66-668d3c56ab8e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:22.612747 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-7cfe8de4-5f2b-4355-9d66-668d3c56ab8e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:22.622192 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7cfe8de4-5f2b-4355-9d66-668d3c56ab8e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1555 microversion: 2.1 time: 0.411182 Jan 05 15:02:22.633217 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 234/480] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:22 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1555 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:22.995058 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8933f1a4-de96-4e59-ae82-f01de73609d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:22.998395 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8933f1a4-de96-4e59-ae82-f01de73609d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:23.022692 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8933f1a4-de96-4e59-ae82-f01de73609d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:23.023152 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8933f1a4-de96-4e59-ae82-f01de73609d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:23.023958 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8933f1a4-de96-4e59-ae82-f01de73609d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:23.024395 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8933f1a4-de96-4e59-ae82-f01de73609d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:23.320960 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8933f1a4-de96-4e59-ae82-f01de73609d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:23.332513 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8933f1a4-de96-4e59-ae82-f01de73609d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:23.336426 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8933f1a4-de96-4e59-ae82-f01de73609d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:23.338866 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8933f1a4-de96-4e59-ae82-f01de73609d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1754 microversion: 2.20 time: 0.348400 Jan 05 15:02:23.340262 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 247/481] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:22 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1754 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:23.639583 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-96c68543-5478-4033-b808-b23267a08ea3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:23.640184 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-96c68543-5478-4033-b808-b23267a08ea3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:23.656997 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96c68543-5478-4033-b808-b23267a08ea3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:23.657708 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96c68543-5478-4033-b808-b23267a08ea3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:23.659317 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96c68543-5478-4033-b808-b23267a08ea3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:23.660157 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96c68543-5478-4033-b808-b23267a08ea3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:23.867153 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-96c68543-5478-4033-b808-b23267a08ea3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:23.879894 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-96c68543-5478-4033-b808-b23267a08ea3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1561 microversion: 2.1 time: 0.243497 Jan 05 15:02:23.893248 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 235/482] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:23 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1561 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:23.961370 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d484e0d4-3e40-496d-a081-db1f0e30ab13 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:23.961980 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d484e0d4-3e40-496d-a081-db1f0e30ab13 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:23.974764 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d484e0d4-3e40-496d-a081-db1f0e30ab13 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:23.979274 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d484e0d4-3e40-496d-a081-db1f0e30ab13 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:23.980368 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d484e0d4-3e40-496d-a081-db1f0e30ab13 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:23.980820 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d484e0d4-3e40-496d-a081-db1f0e30ab13 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:24.341131 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-d484e0d4-3e40-496d-a081-db1f0e30ab13 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lazy-loading 'services' on Instance uuid 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:02:24.364222 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-22becbdc-ae9b-477e-a4db-7026724c3021 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:24.371896 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-22becbdc-ae9b-477e-a4db-7026724c3021 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:24.389321 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-22becbdc-ae9b-477e-a4db-7026724c3021 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:24.389781 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-22becbdc-ae9b-477e-a4db-7026724c3021 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:24.391125 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-22becbdc-ae9b-477e-a4db-7026724c3021 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:24.391563 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-22becbdc-ae9b-477e-a4db-7026724c3021 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:24.700801 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-22becbdc-ae9b-477e-a4db-7026724c3021 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:24.710323 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-22becbdc-ae9b-477e-a4db-7026724c3021 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:24.716330 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-22becbdc-ae9b-477e-a4db-7026724c3021 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:24.721497 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-22becbdc-ae9b-477e-a4db-7026724c3021 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1754 microversion: 2.20 time: 0.360955 Jan 05 15:02:24.732906 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 236/483] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:24 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1754 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:24.846763 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d484e0d4-3e40-496d-a081-db1f0e30ab13 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/os-volume_attachments/707a1b94-49a8-4177-9aa3-2f4feadcbc10" status: 202 len: 0 microversion: 2.1 time: 0.889473 Jan 05 15:02:24.847350 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 248/484] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Jan 5 15:02:23 2022] DELETE /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/os-volume_attachments/707a1b94-49a8-4177-9aa3-2f4feadcbc10 => generated 0 bytes in 891 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:02:24.861357 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-91a5c404-6c92-41f7-b5a3-468c6ee58cb4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:24.867425 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-91a5c404-6c92-41f7-b5a3-468c6ee58cb4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:24.884313 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-91a5c404-6c92-41f7-b5a3-468c6ee58cb4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:24.886692 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-91a5c404-6c92-41f7-b5a3-468c6ee58cb4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:24.889541 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-91a5c404-6c92-41f7-b5a3-468c6ee58cb4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:24.890025 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-91a5c404-6c92-41f7-b5a3-468c6ee58cb4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:24.986859 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-91a5c404-6c92-41f7-b5a3-468c6ee58cb4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134059 Jan 05 15:02:24.991106 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 237/485] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:02:24 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:02:25.742211 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-19121cd8-bd98-4224-9ff7-824e22f1f1a3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:25.744063 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-19121cd8-bd98-4224-9ff7-824e22f1f1a3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:25.757092 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19121cd8-bd98-4224-9ff7-824e22f1f1a3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:25.758839 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19121cd8-bd98-4224-9ff7-824e22f1f1a3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:25.762745 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19121cd8-bd98-4224-9ff7-824e22f1f1a3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:25.763401 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19121cd8-bd98-4224-9ff7-824e22f1f1a3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:26.000588 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-58ccbd02-6384-4dfd-aecd-b5d8f34b747e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:26.002683 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-58ccbd02-6384-4dfd-aecd-b5d8f34b747e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:26.017660 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-58ccbd02-6384-4dfd-aecd-b5d8f34b747e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:26.024265 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-58ccbd02-6384-4dfd-aecd-b5d8f34b747e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:26.024265 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-58ccbd02-6384-4dfd-aecd-b5d8f34b747e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:26.024265 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-58ccbd02-6384-4dfd-aecd-b5d8f34b747e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:26.148330 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-58ccbd02-6384-4dfd-aecd-b5d8f34b747e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144574 Jan 05 15:02:26.153924 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 238/486] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:02:25 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:02:26.664618 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-19121cd8-bd98-4224-9ff7-824e22f1f1a3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:26.690535 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-19121cd8-bd98-4224-9ff7-824e22f1f1a3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:26.692125 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-19121cd8-bd98-4224-9ff7-824e22f1f1a3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:26.697508 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-19121cd8-bd98-4224-9ff7-824e22f1f1a3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.956511 Jan 05 15:02:26.708327 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 249/487] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:25 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:27.160861 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c78e35d6-b818-41af-910d-da934d9e0ade tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:27.162003 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c78e35d6-b818-41af-910d-da934d9e0ade tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:27.169291 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c78e35d6-b818-41af-910d-da934d9e0ade tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:27.169832 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c78e35d6-b818-41af-910d-da934d9e0ade tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:27.170775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c78e35d6-b818-41af-910d-da934d9e0ade tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:27.171464 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c78e35d6-b818-41af-910d-da934d9e0ade tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:27.239493 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c78e35d6-b818-41af-910d-da934d9e0ade tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083423 Jan 05 15:02:27.243070 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 239/488] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:02:27 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 05 15:02:27.717786 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5852ca89-4acd-4f26-8701-86ada6d28cb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:27.718997 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5852ca89-4acd-4f26-8701-86ada6d28cb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:27.729703 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5852ca89-4acd-4f26-8701-86ada6d28cb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:27.733587 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5852ca89-4acd-4f26-8701-86ada6d28cb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:27.735197 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5852ca89-4acd-4f26-8701-86ada6d28cb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:27.735859 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5852ca89-4acd-4f26-8701-86ada6d28cb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:28.173592 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-5852ca89-4acd-4f26-8701-86ada6d28cb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:28.189367 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-5852ca89-4acd-4f26-8701-86ada6d28cb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:28.190975 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-5852ca89-4acd-4f26-8701-86ada6d28cb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:28.192172 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5852ca89-4acd-4f26-8701-86ada6d28cb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.478261 Jan 05 15:02:28.192751 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 250/489] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:27 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:29.211461 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6207a401-a819-46c5-b89b-8ff63bd59bb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:29.212143 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-6207a401-a819-46c5-b89b-8ff63bd59bb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:29.228112 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6207a401-a819-46c5-b89b-8ff63bd59bb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:29.228918 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6207a401-a819-46c5-b89b-8ff63bd59bb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:29.230023 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6207a401-a819-46c5-b89b-8ff63bd59bb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:29.236765 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6207a401-a819-46c5-b89b-8ff63bd59bb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:29.501702 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-6207a401-a819-46c5-b89b-8ff63bd59bb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:29.537947 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-6207a401-a819-46c5-b89b-8ff63bd59bb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:29.542247 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-6207a401-a819-46c5-b89b-8ff63bd59bb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:29.544023 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6207a401-a819-46c5-b89b-8ff63bd59bb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.337046 Jan 05 15:02:29.548267 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 240/490] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:29 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:30.074809 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-efc88a6a-750c-4cee-9e56-70cb784b11ab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:30.076617 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-efc88a6a-750c-4cee-9e56-70cb784b11ab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:30.089204 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efc88a6a-750c-4cee-9e56-70cb784b11ab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:30.103745 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efc88a6a-750c-4cee-9e56-70cb784b11ab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:30.105687 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efc88a6a-750c-4cee-9e56-70cb784b11ab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:30.108520 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efc88a6a-750c-4cee-9e56-70cb784b11ab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:30.202126 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-efc88a6a-750c-4cee-9e56-70cb784b11ab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:02:30.568968 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-386e699b-621a-4582-930d-db1f728e318b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:30.569819 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-386e699b-621a-4582-930d-db1f728e318b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:30.589582 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-386e699b-621a-4582-930d-db1f728e318b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:30.590030 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-386e699b-621a-4582-930d-db1f728e318b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:30.590820 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-386e699b-621a-4582-930d-db1f728e318b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:30.591248 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-386e699b-621a-4582-930d-db1f728e318b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:30.948913 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-efc88a6a-750c-4cee-9e56-70cb784b11ab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "DELETE /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 204 len: 0 microversion: 2.1 time: 0.879858 Jan 05 15:02:30.950094 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 251/491] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:02:30 2022] DELETE /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 0 bytes in 882 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:02:30.959201 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-05b31009-44ae-4c2d-9953-2d850ff2fd37 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:30.960664 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-386e699b-621a-4582-930d-db1f728e318b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:30.961011 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-05b31009-44ae-4c2d-9953-2d850ff2fd37 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:30.971663 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05b31009-44ae-4c2d-9953-2d850ff2fd37 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:30.972122 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05b31009-44ae-4c2d-9953-2d850ff2fd37 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:30.972554 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-386e699b-621a-4582-930d-db1f728e318b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:30.975188 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05b31009-44ae-4c2d-9953-2d850ff2fd37 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:30.975709 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05b31009-44ae-4c2d-9953-2d850ff2fd37 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:30.977133 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-386e699b-621a-4582-930d-db1f728e318b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:30.978351 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-386e699b-621a-4582-930d-db1f728e318b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.413659 Jan 05 15:02:30.993393 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 241/492] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:30 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:31.471727 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-05b31009-44ae-4c2d-9953-2d850ff2fd37 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:31.490612 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-05b31009-44ae-4c2d-9953-2d850ff2fd37 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1509 microversion: 2.1 time: 0.534614 Jan 05 15:02:31.494893 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 252/493] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:30 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1509 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:32.000539 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a0de87c8-8712-484c-8eb9-919b1b8191e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:32.001279 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a0de87c8-8712-484c-8eb9-919b1b8191e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:32.007858 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a0de87c8-8712-484c-8eb9-919b1b8191e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:32.008375 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a0de87c8-8712-484c-8eb9-919b1b8191e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:32.013776 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a0de87c8-8712-484c-8eb9-919b1b8191e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:32.013776 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a0de87c8-8712-484c-8eb9-919b1b8191e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:32.321465 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a0de87c8-8712-484c-8eb9-919b1b8191e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:32.333049 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a0de87c8-8712-484c-8eb9-919b1b8191e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:32.335144 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a0de87c8-8712-484c-8eb9-919b1b8191e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:32.336437 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a0de87c8-8712-484c-8eb9-919b1b8191e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.340424 Jan 05 15:02:32.337580 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 242/494] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:31 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:02:32.511710 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36078416-3adc-4880-adce-0890db1c4330 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:32.512801 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-36078416-3adc-4880-adce-0890db1c4330 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:32.525805 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36078416-3adc-4880-adce-0890db1c4330 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:32.526396 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36078416-3adc-4880-adce-0890db1c4330 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:32.527187 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36078416-3adc-4880-adce-0890db1c4330 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:32.527611 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36078416-3adc-4880-adce-0890db1c4330 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:33.046583 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-36078416-3adc-4880-adce-0890db1c4330 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:33.055126 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-36078416-3adc-4880-adce-0890db1c4330 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1509 microversion: 2.1 time: 0.547048 Jan 05 15:02:33.069975 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 253/495] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:32 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1509 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:33.361815 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-01dabb7a-b215-4034-8336-77b1b58e3c47 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:33.366916 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-01dabb7a-b215-4034-8336-77b1b58e3c47 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:33.385999 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-01dabb7a-b215-4034-8336-77b1b58e3c47 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:33.386457 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-01dabb7a-b215-4034-8336-77b1b58e3c47 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:33.387265 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-01dabb7a-b215-4034-8336-77b1b58e3c47 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:33.387728 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-01dabb7a-b215-4034-8336-77b1b58e3c47 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:33.700256 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-01dabb7a-b215-4034-8336-77b1b58e3c47 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:33.711874 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-01dabb7a-b215-4034-8336-77b1b58e3c47 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:33.719311 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-01dabb7a-b215-4034-8336-77b1b58e3c47 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:33.722056 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-01dabb7a-b215-4034-8336-77b1b58e3c47 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.367316 Jan 05 15:02:33.740786 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 243/496] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:33 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:34.086303 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-680951b0-7997-4879-8fa5-28a54675dfb9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:34.094489 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-680951b0-7997-4879-8fa5-28a54675dfb9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:34.122139 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-680951b0-7997-4879-8fa5-28a54675dfb9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:34.124225 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-680951b0-7997-4879-8fa5-28a54675dfb9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:34.126244 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-680951b0-7997-4879-8fa5-28a54675dfb9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:34.128910 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-680951b0-7997-4879-8fa5-28a54675dfb9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:34.501841 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-680951b0-7997-4879-8fa5-28a54675dfb9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:34.537913 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-680951b0-7997-4879-8fa5-28a54675dfb9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1509 microversion: 2.1 time: 0.455125 Jan 05 15:02:34.541855 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 254/497] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:34 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1509 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:34.794830 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ff999765-4ef4-4c3c-ba92-be39a0f33999 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:34.797611 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ff999765-4ef4-4c3c-ba92-be39a0f33999 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:34.831524 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ff999765-4ef4-4c3c-ba92-be39a0f33999 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:34.839471 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ff999765-4ef4-4c3c-ba92-be39a0f33999 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:34.840855 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ff999765-4ef4-4c3c-ba92-be39a0f33999 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:34.841763 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ff999765-4ef4-4c3c-ba92-be39a0f33999 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:35.190469 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ff999765-4ef4-4c3c-ba92-be39a0f33999 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:35.207665 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ff999765-4ef4-4c3c-ba92-be39a0f33999 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:35.220979 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ff999765-4ef4-4c3c-ba92-be39a0f33999 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:35.235266 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ff999765-4ef4-4c3c-ba92-be39a0f33999 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.481010 Jan 05 15:02:35.236947 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 244/498] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:34 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:35.559431 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d7afabc6-2251-4991-a7e0-61e577e83bee tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:35.561626 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d7afabc6-2251-4991-a7e0-61e577e83bee tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:35.588002 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7afabc6-2251-4991-a7e0-61e577e83bee tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:35.589960 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7afabc6-2251-4991-a7e0-61e577e83bee tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:35.593944 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7afabc6-2251-4991-a7e0-61e577e83bee tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:35.595371 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7afabc6-2251-4991-a7e0-61e577e83bee tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:36.264554 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a17b7113-bc3d-4420-9644-f79b7e8cedc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:36.264554 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a17b7113-bc3d-4420-9644-f79b7e8cedc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:36.265250 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d7afabc6-2251-4991-a7e0-61e577e83bee tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:36.265700 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a17b7113-bc3d-4420-9644-f79b7e8cedc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:36.267609 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a17b7113-bc3d-4420-9644-f79b7e8cedc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:36.268921 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d7afabc6-2251-4991-a7e0-61e577e83bee tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1509 microversion: 2.1 time: 0.714969 Jan 05 15:02:36.273237 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a17b7113-bc3d-4420-9644-f79b7e8cedc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:36.274333 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a17b7113-bc3d-4420-9644-f79b7e8cedc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:36.280856 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 255/499] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:35 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1509 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:36.556568 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a17b7113-bc3d-4420-9644-f79b7e8cedc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:36.568719 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a17b7113-bc3d-4420-9644-f79b7e8cedc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:36.570978 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a17b7113-bc3d-4420-9644-f79b7e8cedc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:36.572390 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a17b7113-bc3d-4420-9644-f79b7e8cedc9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.320912 Jan 05 15:02:36.574945 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 245/500] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:36 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:36.741252 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b74b48a7-e4c9-4787-86fb-5730fb271c0d req-d5cb8fdf-6431-4150-8665-dfd2f54bf52d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f4ef43-fb41-48ea-a380-e03f6fccf9c5", "name": "network-vif-deleted", "tag": "94077c14-de44-48f3-8ca4-3b1be238b708"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:02:36.742861 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:36.742861 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:02:36.750834 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b74b48a7-e4c9-4787-86fb-5730fb271c0d req-d5cb8fdf-6431-4150-8665-dfd2f54bf52d service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:36.752591 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b74b48a7-e4c9-4787-86fb-5730fb271c0d req-d5cb8fdf-6431-4150-8665-dfd2f54bf52d service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:36.762321 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b74b48a7-e4c9-4787-86fb-5730fb271c0d req-d5cb8fdf-6431-4150-8665-dfd2f54bf52d service nova] Creating event network-vif-deleted:94077c14-de44-48f3-8ca4-3b1be238b708 for instance 67f4ef43-fb41-48ea-a380-e03f6fccf9c5 on hv-cinder-maste Jan 05 15:02:36.767640 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b74b48a7-e4c9-4787-86fb-5730fb271c0d req-d5cb8fdf-6431-4150-8665-dfd2f54bf52d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030029 Jan 05 15:02:36.768222 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 256/501] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:02:37.287115 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-008f28e7-7c6f-49e7-8a67-4ca48c4c8104 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:37.288064 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-008f28e7-7c6f-49e7-8a67-4ca48c4c8104 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:37.298888 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-008f28e7-7c6f-49e7-8a67-4ca48c4c8104 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:37.299960 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-008f28e7-7c6f-49e7-8a67-4ca48c4c8104 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:37.301124 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-008f28e7-7c6f-49e7-8a67-4ca48c4c8104 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:37.301744 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-008f28e7-7c6f-49e7-8a67-4ca48c4c8104 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:37.388777 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-008f28e7-7c6f-49e7-8a67-4ca48c4c8104 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:37.402941 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-008f28e7-7c6f-49e7-8a67-4ca48c4c8104 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1293 microversion: 2.1 time: 0.120625 Jan 05 15:02:37.412940 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 246/502] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:37 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1293 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:37.594868 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-33f8a406-185b-495c-90cf-b87ffff75228 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:37.596028 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-33f8a406-185b-495c-90cf-b87ffff75228 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:37.616329 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33f8a406-185b-495c-90cf-b87ffff75228 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:37.617303 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33f8a406-185b-495c-90cf-b87ffff75228 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:37.618943 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33f8a406-185b-495c-90cf-b87ffff75228 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:37.619568 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33f8a406-185b-495c-90cf-b87ffff75228 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:37.857784 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-33f8a406-185b-495c-90cf-b87ffff75228 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:37.894875 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-33f8a406-185b-495c-90cf-b87ffff75228 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:37.900718 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-33f8a406-185b-495c-90cf-b87ffff75228 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:37.905508 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-33f8a406-185b-495c-90cf-b87ffff75228 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.316607 Jan 05 15:02:37.934889 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 257/503] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:37 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:38.428760 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-eefeb297-e2a7-49ce-995b-a19fe7d70a92 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:38.430810 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-eefeb297-e2a7-49ce-995b-a19fe7d70a92 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:38.458419 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-eefeb297-e2a7-49ce-995b-a19fe7d70a92 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:38.459356 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-eefeb297-e2a7-49ce-995b-a19fe7d70a92 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:38.461780 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-eefeb297-e2a7-49ce-995b-a19fe7d70a92 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:38.462491 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-eefeb297-e2a7-49ce-995b-a19fe7d70a92 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:38.548084 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-eefeb297-e2a7-49ce-995b-a19fe7d70a92 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:38.574683 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-eefeb297-e2a7-49ce-995b-a19fe7d70a92 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1293 microversion: 2.1 time: 0.158482 Jan 05 15:02:38.586145 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 247/504] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:38 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1293 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:02:38.924849 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fbf702fc-1425-4e3e-8422-b14f32d97756 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:38.926261 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fbf702fc-1425-4e3e-8422-b14f32d97756 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:38.932719 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbf702fc-1425-4e3e-8422-b14f32d97756 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:38.945713 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbf702fc-1425-4e3e-8422-b14f32d97756 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:38.946750 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbf702fc-1425-4e3e-8422-b14f32d97756 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:38.947287 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbf702fc-1425-4e3e-8422-b14f32d97756 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:39.191868 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-fbf702fc-1425-4e3e-8422-b14f32d97756 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:39.201044 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-fbf702fc-1425-4e3e-8422-b14f32d97756 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:39.202974 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-fbf702fc-1425-4e3e-8422-b14f32d97756 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:39.204407 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fbf702fc-1425-4e3e-8422-b14f32d97756 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.283581 Jan 05 15:02:39.215972 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 258/505] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:38 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:39.593652 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-5b188371-47b8-49f3-8e5f-778f0f636710 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:39.595125 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-5b188371-47b8-49f3-8e5f-778f0f636710 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:39.601812 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5b188371-47b8-49f3-8e5f-778f0f636710 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:39.602701 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5b188371-47b8-49f3-8e5f-778f0f636710 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:39.603747 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5b188371-47b8-49f3-8e5f-778f0f636710 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:39.604679 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5b188371-47b8-49f3-8e5f-778f0f636710 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:39.673590 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-5b188371-47b8-49f3-8e5f-778f0f636710 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:39.681831 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-5b188371-47b8-49f3-8e5f-778f0f636710 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1293 microversion: 2.1 time: 0.091866 Jan 05 15:02:39.689090 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 248/506] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:39 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:02:40.223732 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e32bb38a-e369-430a-9563-975b490fd414 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:40.224460 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e32bb38a-e369-430a-9563-975b490fd414 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:40.230863 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e32bb38a-e369-430a-9563-975b490fd414 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:40.231306 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e32bb38a-e369-430a-9563-975b490fd414 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:40.232062 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e32bb38a-e369-430a-9563-975b490fd414 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:40.232487 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e32bb38a-e369-430a-9563-975b490fd414 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:40.361670 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e32bb38a-e369-430a-9563-975b490fd414 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:40.370373 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e32bb38a-e369-430a-9563-975b490fd414 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:40.371861 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e32bb38a-e369-430a-9563-975b490fd414 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:40.373008 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e32bb38a-e369-430a-9563-975b490fd414 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.153051 Jan 05 15:02:40.373616 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 259/507] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:40 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:40.700938 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-55f22358-7e58-4b0a-a330-98ed7009c119 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:40.701854 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-55f22358-7e58-4b0a-a330-98ed7009c119 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:40.719530 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-55f22358-7e58-4b0a-a330-98ed7009c119 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:40.719927 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-55f22358-7e58-4b0a-a330-98ed7009c119 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:40.720710 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-55f22358-7e58-4b0a-a330-98ed7009c119 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:40.721178 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-55f22358-7e58-4b0a-a330-98ed7009c119 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:40.780002 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-55f22358-7e58-4b0a-a330-98ed7009c119 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:40.780424 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-55f22358-7e58-4b0a-a330-98ed7009c119 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:40.781248 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-55f22358-7e58-4b0a-a330-98ed7009c119 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lazy-loading 'fault' on Instance uuid 67f4ef43-fb41-48ea-a380-e03f6fccf9c5 {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:02:40.831365 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-55f22358-7e58-4b0a-a330-98ed7009c119 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:40.841675 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-55f22358-7e58-4b0a-a330-98ed7009c119 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1312 microversion: 2.1 time: 0.144373 Jan 05 15:02:40.843579 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 249/508] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:40 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1312 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:41.393367 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6f2792bc-537f-4951-92c1-d7f3915ab619 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:41.394068 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6f2792bc-537f-4951-92c1-d7f3915ab619 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:41.413836 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f2792bc-537f-4951-92c1-d7f3915ab619 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:41.414561 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f2792bc-537f-4951-92c1-d7f3915ab619 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:41.415709 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f2792bc-537f-4951-92c1-d7f3915ab619 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:41.416375 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f2792bc-537f-4951-92c1-d7f3915ab619 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:41.597973 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6f2792bc-537f-4951-92c1-d7f3915ab619 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:41.607303 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6f2792bc-537f-4951-92c1-d7f3915ab619 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:41.609723 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6f2792bc-537f-4951-92c1-d7f3915ab619 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:41.611057 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6f2792bc-537f-4951-92c1-d7f3915ab619 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.221923 Jan 05 15:02:41.622554 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 260/509] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:41 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:41.860568 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-57577bca-e97b-4bec-b504-6069d324f757 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:41.861235 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-57577bca-e97b-4bec-b504-6069d324f757 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:41.868051 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-57577bca-e97b-4bec-b504-6069d324f757 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:41.869429 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-57577bca-e97b-4bec-b504-6069d324f757 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:41.870248 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-57577bca-e97b-4bec-b504-6069d324f757 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:41.870688 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-57577bca-e97b-4bec-b504-6069d324f757 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:41.906529 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-57577bca-e97b-4bec-b504-6069d324f757 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:41.907692 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-57577bca-e97b-4bec-b504-6069d324f757 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:41.908347 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-57577bca-e97b-4bec-b504-6069d324f757 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lazy-loading 'fault' on Instance uuid 67f4ef43-fb41-48ea-a380-e03f6fccf9c5 {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:02:41.949663 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-57577bca-e97b-4bec-b504-6069d324f757 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:41.958093 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-57577bca-e97b-4bec-b504-6069d324f757 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 200 len: 1312 microversion: 2.1 time: 0.101488 Jan 05 15:02:41.959137 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 250/510] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:41 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:42.633911 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dfeeb88e-3459-496e-857f-30e02f76606d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:42.635905 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dfeeb88e-3459-496e-857f-30e02f76606d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:42.649223 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfeeb88e-3459-496e-857f-30e02f76606d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:42.650439 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfeeb88e-3459-496e-857f-30e02f76606d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:42.651792 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfeeb88e-3459-496e-857f-30e02f76606d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:42.652613 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfeeb88e-3459-496e-857f-30e02f76606d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:42.932938 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-dfeeb88e-3459-496e-857f-30e02f76606d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:42.962896 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-dfeeb88e-3459-496e-857f-30e02f76606d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:42.974407 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-dfeeb88e-3459-496e-857f-30e02f76606d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:42.974407 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dfeeb88e-3459-496e-857f-30e02f76606d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.340111 Jan 05 15:02:42.977768 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 261/511] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:42 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:42.980868 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-64a4eee7-9328-4ff1-9c95-8f0d7c06f9b9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:42.982163 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-64a4eee7-9328-4ff1-9c95-8f0d7c06f9b9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 67f4ef43-fb41-48ea-a380-e03f6fccf9c5] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:42.989098 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-64a4eee7-9328-4ff1-9c95-8f0d7c06f9b9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:42.989618 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-64a4eee7-9328-4ff1-9c95-8f0d7c06f9b9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:42.990476 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-64a4eee7-9328-4ff1-9c95-8f0d7c06f9b9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:42.991010 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-64a4eee7-9328-4ff1-9c95-8f0d7c06f9b9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:43.020407 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-64a4eee7-9328-4ff1-9c95-8f0d7c06f9b9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] HTTP exception thrown: Instance 67f4ef43-fb41-48ea-a380-e03f6fccf9c5 could not be found. Jan 05 15:02:43.021424 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-64a4eee7-9328-4ff1-9c95-8f0d7c06f9b9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Returning 404 to user: Instance 67f4ef43-fb41-48ea-a380-e03f6fccf9c5 could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:02:43.022796 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-64a4eee7-9328-4ff1-9c95-8f0d7c06f9b9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5" status: 404 len: 111 microversion: 2.1 time: 0.051020 Jan 05 15:02:43.024492 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 251/512] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:42 2022] GET /compute/v2.1/servers/67f4ef43-fb41-48ea-a380-e03f6fccf9c5 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:02:43.037814 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:43.039077 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:43.060029 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:43.061294 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:43.065672 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:43.066872 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:43.134312 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:02:43.634785 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-097a4c3e-3048-4f62-9630-bf9385be1d66 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:43.635722 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-097a4c3e-3048-4f62-9630-bf9385be1d66 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:43.647180 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-097a4c3e-3048-4f62-9630-bf9385be1d66 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:43.650394 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-097a4c3e-3048-4f62-9630-bf9385be1d66 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:43.651870 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-097a4c3e-3048-4f62-9630-bf9385be1d66 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:43.654246 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-097a4c3e-3048-4f62-9630-bf9385be1d66 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:43.794338 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 204 len: 0 microversion: 2.1 time: 0.764046 Jan 05 15:02:43.798585 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 262/513] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:02:43 2022] DELETE /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 0 bytes in 766 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:02:43.805963 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4c5a3a48-4e43-4968-b1cf-a99bb4b19109 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:43.805963 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4c5a3a48-4e43-4968-b1cf-a99bb4b19109 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:43.827034 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c5a3a48-4e43-4968-b1cf-a99bb4b19109 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:43.828049 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c5a3a48-4e43-4968-b1cf-a99bb4b19109 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:43.831993 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c5a3a48-4e43-4968-b1cf-a99bb4b19109 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:43.834742 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c5a3a48-4e43-4968-b1cf-a99bb4b19109 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:43.904739 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-097a4c3e-3048-4f62-9630-bf9385be1d66 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lazy-loading 'services' on Instance uuid 3327c27f-a8e9-4b19-8041-fb5260278159 {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:02:44.100217 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4c5a3a48-4e43-4968-b1cf-a99bb4b19109 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:44.109437 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4c5a3a48-4e43-4968-b1cf-a99bb4b19109 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1521 microversion: 2.1 time: 0.308728 Jan 05 15:02:44.110634 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 263/514] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:43 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:44.122376 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a933b413-d74f-4659-9dcb-166416914d7b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:44.122376 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a933b413-d74f-4659-9dcb-166416914d7b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:44.122376 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a933b413-d74f-4659-9dcb-166416914d7b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:44.122847 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a933b413-d74f-4659-9dcb-166416914d7b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:44.123719 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a933b413-d74f-4659-9dcb-166416914d7b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:44.124154 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a933b413-d74f-4659-9dcb-166416914d7b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:44.280580 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a933b413-d74f-4659-9dcb-166416914d7b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:44.283709 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-097a4c3e-3048-4f62-9630-bf9385be1d66 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/os-volume_attachments/d61088ea-b133-4a09-b64f-263589bd3a31" status: 202 len: 0 microversion: 2.1 time: 0.652968 Jan 05 15:02:44.285179 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 252/515] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Jan 5 15:02:43 2022] DELETE /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/os-volume_attachments/d61088ea-b133-4a09-b64f-263589bd3a31 => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:02:44.289423 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a933b413-d74f-4659-9dcb-166416914d7b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:44.290926 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a933b413-d74f-4659-9dcb-166416914d7b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:44.292070 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a933b413-d74f-4659-9dcb-166416914d7b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.180508 Jan 05 15:02:44.292763 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 264/516] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:44 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:45.133236 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ec9de76d-c65e-4450-a427-9a94610f3431 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:45.134347 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ec9de76d-c65e-4450-a427-9a94610f3431 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:45.150411 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ec9de76d-c65e-4450-a427-9a94610f3431 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:45.150411 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ec9de76d-c65e-4450-a427-9a94610f3431 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:45.150411 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ec9de76d-c65e-4450-a427-9a94610f3431 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:45.150411 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ec9de76d-c65e-4450-a427-9a94610f3431 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:45.319192 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-57848534-2805-4e94-b47a-4c5c38498f69 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:45.322070 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-57848534-2805-4e94-b47a-4c5c38498f69 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:45.330834 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ec9de76d-c65e-4450-a427-9a94610f3431 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:45.337617 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57848534-2805-4e94-b47a-4c5c38498f69 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:45.338151 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57848534-2805-4e94-b47a-4c5c38498f69 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:45.344420 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ec9de76d-c65e-4450-a427-9a94610f3431 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1521 microversion: 2.1 time: 0.216610 Jan 05 15:02:45.345573 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 253/517] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:45 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:45.345952 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57848534-2805-4e94-b47a-4c5c38498f69 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:45.346527 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57848534-2805-4e94-b47a-4c5c38498f69 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:45.566704 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-57848534-2805-4e94-b47a-4c5c38498f69 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:45.576123 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-57848534-2805-4e94-b47a-4c5c38498f69 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:45.578559 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-57848534-2805-4e94-b47a-4c5c38498f69 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:45.579995 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-57848534-2805-4e94-b47a-4c5c38498f69 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.271982 Jan 05 15:02:45.581303 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 265/518] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:45 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:46.362972 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-fa2f99cf-9a29-4a77-b2fc-eb6cd4911167 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:46.364933 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-fa2f99cf-9a29-4a77-b2fc-eb6cd4911167 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:46.373264 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fa2f99cf-9a29-4a77-b2fc-eb6cd4911167 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:46.375362 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fa2f99cf-9a29-4a77-b2fc-eb6cd4911167 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:46.376445 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fa2f99cf-9a29-4a77-b2fc-eb6cd4911167 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:46.377139 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fa2f99cf-9a29-4a77-b2fc-eb6cd4911167 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:46.564084 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-fa2f99cf-9a29-4a77-b2fc-eb6cd4911167 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:46.572682 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-fa2f99cf-9a29-4a77-b2fc-eb6cd4911167 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1521 microversion: 2.1 time: 0.214776 Jan 05 15:02:46.575717 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 254/519] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:46 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:46.588424 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e96e23ff-312d-4a45-8fca-779fd19f0a18 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:02:46.588424 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e96e23ff-312d-4a45-8fca-779fd19f0a18 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:46.588424 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e96e23ff-312d-4a45-8fca-779fd19f0a18 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:46.599518 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c169f833-df19-4dcb-b8ae-862be1d5e2d9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:46.601368 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c169f833-df19-4dcb-b8ae-862be1d5e2d9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:46.614259 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e96e23ff-312d-4a45-8fca-779fd19f0a18 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Going to try to stop instance {{(pid=128788) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 05 15:02:46.614504 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c169f833-df19-4dcb-b8ae-862be1d5e2d9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:46.614999 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c169f833-df19-4dcb-b8ae-862be1d5e2d9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:46.615891 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c169f833-df19-4dcb-b8ae-862be1d5e2d9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:46.616572 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c169f833-df19-4dcb-b8ae-862be1d5e2d9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:46.766895 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c169f833-df19-4dcb-b8ae-862be1d5e2d9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:46.775857 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c169f833-df19-4dcb-b8ae-862be1d5e2d9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:46.777408 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c169f833-df19-4dcb-b8ae-862be1d5e2d9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:46.778592 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c169f833-df19-4dcb-b8ae-862be1d5e2d9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.182713 Jan 05 15:02:46.789978 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 255/520] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:46 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:02:47.596767 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c9347bf9-119b-4fdc-9a09-3030a0dcb65f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:47.597579 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c9347bf9-119b-4fdc-9a09-3030a0dcb65f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:47.604696 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c9347bf9-119b-4fdc-9a09-3030a0dcb65f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:47.605208 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c9347bf9-119b-4fdc-9a09-3030a0dcb65f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:47.606096 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c9347bf9-119b-4fdc-9a09-3030a0dcb65f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:47.606596 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c9347bf9-119b-4fdc-9a09-3030a0dcb65f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:47.753419 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c9347bf9-119b-4fdc-9a09-3030a0dcb65f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:47.759487 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e96e23ff-312d-4a45-8fca-779fd19f0a18 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 202 len: 0 microversion: 2.1 time: 1.185812 Jan 05 15:02:47.760238 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 266/521] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:02:46 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 0 bytes in 1188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:02:47.760900 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c9347bf9-119b-4fdc-9a09-3030a0dcb65f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1521 microversion: 2.1 time: 0.169528 Jan 05 15:02:47.761489 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 256/522] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:47 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:02:47.769404 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4814f12e-1999-4e21-acc8-6630c3aaed3e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:47.770168 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4814f12e-1999-4e21-acc8-6630c3aaed3e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:47.776486 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4814f12e-1999-4e21-acc8-6630c3aaed3e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:47.776993 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4814f12e-1999-4e21-acc8-6630c3aaed3e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:47.777807 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4814f12e-1999-4e21-acc8-6630c3aaed3e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:47.778235 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4814f12e-1999-4e21-acc8-6630c3aaed3e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:47.797297 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-65bd0e7c-be81-4f4f-acc7-cf3ac7d38743 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:47.799384 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-65bd0e7c-be81-4f4f-acc7-cf3ac7d38743 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:47.803559 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-65bd0e7c-be81-4f4f-acc7-cf3ac7d38743 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:47.804009 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-65bd0e7c-be81-4f4f-acc7-cf3ac7d38743 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:47.804776 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-65bd0e7c-be81-4f4f-acc7-cf3ac7d38743 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:47.805229 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-65bd0e7c-be81-4f4f-acc7-cf3ac7d38743 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:47.914656 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4814f12e-1999-4e21-acc8-6630c3aaed3e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:47.925106 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4814f12e-1999-4e21-acc8-6630c3aaed3e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1675 microversion: 2.1 time: 0.160178 Jan 05 15:02:47.925714 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 267/523] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:47 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:47.965294 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-65bd0e7c-be81-4f4f-acc7-cf3ac7d38743 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:47.975740 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-65bd0e7c-be81-4f4f-acc7-cf3ac7d38743 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:47.977597 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-65bd0e7c-be81-4f4f-acc7-cf3ac7d38743 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:47.978938 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-65bd0e7c-be81-4f4f-acc7-cf3ac7d38743 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.185147 Jan 05 15:02:47.979828 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 257/524] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:47 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:02:48.778929 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef516f91-9ce0-4202-a886-fb10eee17cfb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:48.780283 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ef516f91-9ce0-4202-a886-fb10eee17cfb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:48.786456 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef516f91-9ce0-4202-a886-fb10eee17cfb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:48.787150 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef516f91-9ce0-4202-a886-fb10eee17cfb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:48.788321 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef516f91-9ce0-4202-a886-fb10eee17cfb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:48.793100 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef516f91-9ce0-4202-a886-fb10eee17cfb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:48.936403 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-ef516f91-9ce0-4202-a886-fb10eee17cfb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:48.942758 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e161372a-0e34-4b91-a6a9-301cfaa68e19 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:48.943923 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e161372a-0e34-4b91-a6a9-301cfaa68e19 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:48.944216 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ef516f91-9ce0-4202-a886-fb10eee17cfb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1521 microversion: 2.1 time: 0.169537 Jan 05 15:02:48.948864 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 268/525] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:48 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:48.965738 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e161372a-0e34-4b91-a6a9-301cfaa68e19 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:48.966483 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e161372a-0e34-4b91-a6a9-301cfaa68e19 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:48.967286 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e161372a-0e34-4b91-a6a9-301cfaa68e19 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:48.967720 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e161372a-0e34-4b91-a6a9-301cfaa68e19 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:48.998523 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de3d7a9a-d989-4135-bfe9-0e28ff3a7ae5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:48.999184 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-de3d7a9a-d989-4135-bfe9-0e28ff3a7ae5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:49.007492 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de3d7a9a-d989-4135-bfe9-0e28ff3a7ae5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:49.008003 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de3d7a9a-d989-4135-bfe9-0e28ff3a7ae5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:49.008799 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de3d7a9a-d989-4135-bfe9-0e28ff3a7ae5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:49.031263 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de3d7a9a-d989-4135-bfe9-0e28ff3a7ae5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:49.161864 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e161372a-0e34-4b91-a6a9-301cfaa68e19 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:49.170988 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e161372a-0e34-4b91-a6a9-301cfaa68e19 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1675 microversion: 2.1 time: 0.231857 Jan 05 15:02:49.173111 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 258/526] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:48 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:02:49.248341 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-de3d7a9a-d989-4135-bfe9-0e28ff3a7ae5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:49.258400 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-de3d7a9a-d989-4135-bfe9-0e28ff3a7ae5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:49.260358 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-de3d7a9a-d989-4135-bfe9-0e28ff3a7ae5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:49.261656 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-de3d7a9a-d989-4135-bfe9-0e28ff3a7ae5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.266835 Jan 05 15:02:49.276269 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 269/527] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:48 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:02:49.962164 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a1213a15-b818-4d84-8c08-a2256da48c81 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:49.963768 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a1213a15-b818-4d84-8c08-a2256da48c81 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:49.971518 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a1213a15-b818-4d84-8c08-a2256da48c81 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:49.972584 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a1213a15-b818-4d84-8c08-a2256da48c81 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:49.973931 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a1213a15-b818-4d84-8c08-a2256da48c81 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:49.974643 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a1213a15-b818-4d84-8c08-a2256da48c81 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:50.059136 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-95d08d7a-46a8-4fc8-96bb-c52a8d224a7b req-7f177eee-9c06-44b6-a632-6a6529388325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e27001d-6fb2-4283-b4e6-19f0aec6d3cb", "name": "network-vif-deleted", "tag": "7e97ea9f-9968-4d12-a26d-c48d64741cea"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:02:50.060779 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:50.060779 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:02:50.073677 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-95d08d7a-46a8-4fc8-96bb-c52a8d224a7b req-7f177eee-9c06-44b6-a632-6a6529388325 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:50.084877 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-95d08d7a-46a8-4fc8-96bb-c52a8d224a7b req-7f177eee-9c06-44b6-a632-6a6529388325 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:50.104958 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-95d08d7a-46a8-4fc8-96bb-c52a8d224a7b req-7f177eee-9c06-44b6-a632-6a6529388325 service nova] Creating event network-vif-deleted:7e97ea9f-9968-4d12-a26d-c48d64741cea for instance 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb on hv-cinder-maste Jan 05 15:02:50.105982 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a1213a15-b818-4d84-8c08-a2256da48c81 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:50.110597 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-95d08d7a-46a8-4fc8-96bb-c52a8d224a7b req-7f177eee-9c06-44b6-a632-6a6529388325 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056038 Jan 05 15:02:50.111419 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 270/528] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:02:50.120545 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a1213a15-b818-4d84-8c08-a2256da48c81 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1479 microversion: 2.1 time: 0.161404 Jan 05 15:02:50.126018 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 259/529] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:49 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1479 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:50.192026 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c0c0f606-b8f2-4692-a7af-9134929b3902 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:50.193298 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c0c0f606-b8f2-4692-a7af-9134929b3902 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:50.200169 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0c0f606-b8f2-4692-a7af-9134929b3902 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:50.200768 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0c0f606-b8f2-4692-a7af-9134929b3902 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:50.201599 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0c0f606-b8f2-4692-a7af-9134929b3902 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:50.202208 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0c0f606-b8f2-4692-a7af-9134929b3902 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:50.280696 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c1205764-8126-4fc9-855a-3ff6e4903217 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:50.281363 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c1205764-8126-4fc9-855a-3ff6e4903217 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:50.288332 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c1205764-8126-4fc9-855a-3ff6e4903217 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:50.288786 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c1205764-8126-4fc9-855a-3ff6e4903217 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:50.289602 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c1205764-8126-4fc9-855a-3ff6e4903217 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:50.290035 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c1205764-8126-4fc9-855a-3ff6e4903217 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:50.438810 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-c0c0f606-b8f2-4692-a7af-9134929b3902 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:50.486366 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c0c0f606-b8f2-4692-a7af-9134929b3902 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1675 microversion: 2.1 time: 0.290819 Jan 05 15:02:50.489170 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 271/530] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:50 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1675 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:50.557083 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c1205764-8126-4fc9-855a-3ff6e4903217 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:50.597530 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c1205764-8126-4fc9-855a-3ff6e4903217 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:50.597530 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c1205764-8126-4fc9-855a-3ff6e4903217 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:50.597530 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c1205764-8126-4fc9-855a-3ff6e4903217 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.294083 Jan 05 15:02:50.598006 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 260/531] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:50 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:02:51.137425 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-150dab1b-5bc6-4015-b79d-aa53049a2987 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:51.138682 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-150dab1b-5bc6-4015-b79d-aa53049a2987 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:51.145537 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-150dab1b-5bc6-4015-b79d-aa53049a2987 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:51.145988 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-150dab1b-5bc6-4015-b79d-aa53049a2987 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:51.146810 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-150dab1b-5bc6-4015-b79d-aa53049a2987 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:51.147191 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-150dab1b-5bc6-4015-b79d-aa53049a2987 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:51.185952 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-150dab1b-5bc6-4015-b79d-aa53049a2987 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:51.186401 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-150dab1b-5bc6-4015-b79d-aa53049a2987 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:51.187107 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-150dab1b-5bc6-4015-b79d-aa53049a2987 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lazy-loading 'fault' on Instance uuid 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:02:51.236470 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-150dab1b-5bc6-4015-b79d-aa53049a2987 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4295ba06618a45988ebeb45a82230bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7d005c6e9e454fa506907144639917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:51.246611 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-150dab1b-5bc6-4015-b79d-aa53049a2987 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 200 len: 1311 microversion: 2.1 time: 0.113015 Jan 05 15:02:51.247237 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 272/532] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:51 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:51.504262 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7421b434-e4f4-4ac1-8869-b1607cfd5053 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:51.506016 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7421b434-e4f4-4ac1-8869-b1607cfd5053 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:51.514910 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7421b434-e4f4-4ac1-8869-b1607cfd5053 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:51.515372 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7421b434-e4f4-4ac1-8869-b1607cfd5053 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:51.516174 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7421b434-e4f4-4ac1-8869-b1607cfd5053 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:51.516613 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7421b434-e4f4-4ac1-8869-b1607cfd5053 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:51.592678 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f27ee74-0c75-4a1b-bbd0-bdd5b4770d74 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:51.593332 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4f27ee74-0c75-4a1b-bbd0-bdd5b4770d74 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:51.599947 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f27ee74-0c75-4a1b-bbd0-bdd5b4770d74 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:51.600687 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f27ee74-0c75-4a1b-bbd0-bdd5b4770d74 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:51.601535 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f27ee74-0c75-4a1b-bbd0-bdd5b4770d74 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:51.602139 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f27ee74-0c75-4a1b-bbd0-bdd5b4770d74 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:51.741034 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-7421b434-e4f4-4ac1-8869-b1607cfd5053 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:51.749108 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7421b434-e4f4-4ac1-8869-b1607cfd5053 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1675 microversion: 2.1 time: 0.248309 Jan 05 15:02:51.760561 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 261/533] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:51 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1675 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:51.862637 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4f27ee74-0c75-4a1b-bbd0-bdd5b4770d74 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:51.872390 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4f27ee74-0c75-4a1b-bbd0-bdd5b4770d74 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:51.874038 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4f27ee74-0c75-4a1b-bbd0-bdd5b4770d74 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:51.875903 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4f27ee74-0c75-4a1b-bbd0-bdd5b4770d74 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.287016 Jan 05 15:02:51.876568 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 273/534] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:51 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:02:52.264126 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-787e4f45-1999-4b76-a4f6-a6cbc9c0bf65 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:52.265467 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-787e4f45-1999-4b76-a4f6-a6cbc9c0bf65 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] [instance: 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:52.274155 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-787e4f45-1999-4b76-a4f6-a6cbc9c0bf65 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:52.275943 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-787e4f45-1999-4b76-a4f6-a6cbc9c0bf65 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:52.276940 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-787e4f45-1999-4b76-a4f6-a6cbc9c0bf65 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:52.277976 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-787e4f45-1999-4b76-a4f6-a6cbc9c0bf65 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:52.299290 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-787e4f45-1999-4b76-a4f6-a6cbc9c0bf65 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] HTTP exception thrown: Instance 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb could not be found. Jan 05 15:02:52.300133 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-787e4f45-1999-4b76-a4f6-a6cbc9c0bf65 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Returning 404 to user: Instance 2e27001d-6fb2-4283-b4e6-19f0aec6d3cb could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:02:52.301571 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-787e4f45-1999-4b76-a4f6-a6cbc9c0bf65 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb" status: 404 len: 111 microversion: 2.1 time: 0.041499 Jan 05 15:02:52.302828 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 262/535] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:52 2022] GET /compute/v2.1/servers/2e27001d-6fb2-4283-b4e6-19f0aec6d3cb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:02:52.720469 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9af84edc-9585-4281-9511-51f2fd194b9f req-c426a60a-315a-419e-a6a6-be115ee2792f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "name": "network-vif-plugged", "status": "completed", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:02:52.722655 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:52.722655 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:02:52.741941 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9af84edc-9585-4281-9511-51f2fd194b9f req-c426a60a-315a-419e-a6a6-be115ee2792f service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:52.743920 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9af84edc-9585-4281-9511-51f2fd194b9f req-c426a60a-315a-419e-a6a6-be115ee2792f service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:52.766559 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-0d06918d-d3c7-4f83-b813-76007ceb6f29 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:52.767753 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0d06918d-d3c7-4f83-b813-76007ceb6f29 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:52.777023 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0d06918d-d3c7-4f83-b813-76007ceb6f29 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:52.777502 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0d06918d-d3c7-4f83-b813-76007ceb6f29 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:52.782080 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9af84edc-9585-4281-9511-51f2fd194b9f req-c426a60a-315a-419e-a6a6-be115ee2792f service nova] Creating event network-vif-plugged:45483c3c-9f42-4aff-a962-22ff36647afc for instance 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 on hv-cinder-maste Jan 05 15:02:52.790390 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0d06918d-d3c7-4f83-b813-76007ceb6f29 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:52.790882 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0d06918d-d3c7-4f83-b813-76007ceb6f29 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:52.803383 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9af84edc-9585-4281-9511-51f2fd194b9f req-c426a60a-315a-419e-a6a6-be115ee2792f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088668 Jan 05 15:02:52.805736 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 274/536] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:02:52.895784 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-680a3f1b-f7f5-40bc-9291-17762befdc1b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:52.896678 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-680a3f1b-f7f5-40bc-9291-17762befdc1b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:52.912029 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-680a3f1b-f7f5-40bc-9291-17762befdc1b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:52.912769 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-680a3f1b-f7f5-40bc-9291-17762befdc1b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:52.916217 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-680a3f1b-f7f5-40bc-9291-17762befdc1b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:52.922392 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-680a3f1b-f7f5-40bc-9291-17762befdc1b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:53.133086 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-0d06918d-d3c7-4f83-b813-76007ceb6f29 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:53.167681 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-0d06918d-d3c7-4f83-b813-76007ceb6f29 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1675 microversion: 2.1 time: 0.393381 Jan 05 15:02:53.172009 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 263/537] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:52 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1675 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:02:53.214176 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-680a3f1b-f7f5-40bc-9291-17762befdc1b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:53.226902 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-680a3f1b-f7f5-40bc-9291-17762befdc1b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:53.228664 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-680a3f1b-f7f5-40bc-9291-17762befdc1b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:53.230276 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-680a3f1b-f7f5-40bc-9291-17762befdc1b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.338979 Jan 05 15:02:53.231168 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 275/538] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:52 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:54.195720 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-888191c6-ebc1-466d-9e70-661223c9fdb1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:54.196332 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-888191c6-ebc1-466d-9e70-661223c9fdb1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:54.203470 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-888191c6-ebc1-466d-9e70-661223c9fdb1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:54.204328 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-888191c6-ebc1-466d-9e70-661223c9fdb1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:54.211198 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-888191c6-ebc1-466d-9e70-661223c9fdb1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:54.211198 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-888191c6-ebc1-466d-9e70-661223c9fdb1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:54.249642 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d05e8477-a71e-40cd-983d-088863fca891 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:54.250433 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d05e8477-a71e-40cd-983d-088863fca891 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:54.257375 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d05e8477-a71e-40cd-983d-088863fca891 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:54.258241 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d05e8477-a71e-40cd-983d-088863fca891 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:54.259196 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d05e8477-a71e-40cd-983d-088863fca891 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:54.259724 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d05e8477-a71e-40cd-983d-088863fca891 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:54.625706 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d05e8477-a71e-40cd-983d-088863fca891 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:54.634948 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d05e8477-a71e-40cd-983d-088863fca891 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:54.636994 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d05e8477-a71e-40cd-983d-088863fca891 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:54.638985 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d05e8477-a71e-40cd-983d-088863fca891 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.393527 Jan 05 15:02:54.640860 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 276/539] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:54 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:02:54.714935 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-888191c6-ebc1-466d-9e70-661223c9fdb1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:54.727058 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-888191c6-ebc1-466d-9e70-661223c9fdb1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1675 microversion: 2.1 time: 0.532794 Jan 05 15:02:54.729771 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 264/540] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:54 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1675 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:55.659530 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e3f132e9-c262-4f08-a8b3-5b29d02413c8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:55.682388 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e3f132e9-c262-4f08-a8b3-5b29d02413c8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:55.682388 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3f132e9-c262-4f08-a8b3-5b29d02413c8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:55.682388 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3f132e9-c262-4f08-a8b3-5b29d02413c8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:55.682388 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3f132e9-c262-4f08-a8b3-5b29d02413c8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:55.682760 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3f132e9-c262-4f08-a8b3-5b29d02413c8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:55.747602 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-12951726-5cb4-4598-8d20-bc6991c8203a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:55.748224 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-12951726-5cb4-4598-8d20-bc6991c8203a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:55.756705 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-12951726-5cb4-4598-8d20-bc6991c8203a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:55.757180 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-12951726-5cb4-4598-8d20-bc6991c8203a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:55.758157 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-12951726-5cb4-4598-8d20-bc6991c8203a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:55.758595 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-12951726-5cb4-4598-8d20-bc6991c8203a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:55.916952 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e3f132e9-c262-4f08-a8b3-5b29d02413c8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:55.932967 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e3f132e9-c262-4f08-a8b3-5b29d02413c8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:55.933439 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-12951726-5cb4-4598-8d20-bc6991c8203a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:55.935058 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e3f132e9-c262-4f08-a8b3-5b29d02413c8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:55.936645 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e3f132e9-c262-4f08-a8b3-5b29d02413c8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.281920 Jan 05 15:02:55.938183 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 277/541] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:55 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:02:55.943783 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-12951726-5cb4-4598-8d20-bc6991c8203a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1675 microversion: 2.1 time: 0.201123 Jan 05 15:02:55.944354 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 265/542] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:55 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1675 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:56.599318 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 15:02:56.599572 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: Wed Jan 5 15:02:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 15:02:56.957497 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d0964c53-90c0-4811-968e-2964ad762214 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:56.958115 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d0964c53-90c0-4811-968e-2964ad762214 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:56.960845 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f53f4257-2b01-4bb9-8e89-6fc790b82623 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:56.961580 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f53f4257-2b01-4bb9-8e89-6fc790b82623 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:56.973377 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f53f4257-2b01-4bb9-8e89-6fc790b82623 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:56.975557 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f53f4257-2b01-4bb9-8e89-6fc790b82623 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:56.975697 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0964c53-90c0-4811-968e-2964ad762214 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:56.975995 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0964c53-90c0-4811-968e-2964ad762214 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:56.976938 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0964c53-90c0-4811-968e-2964ad762214 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:56.977397 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0964c53-90c0-4811-968e-2964ad762214 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:56.977981 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f53f4257-2b01-4bb9-8e89-6fc790b82623 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:56.979862 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f53f4257-2b01-4bb9-8e89-6fc790b82623 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:57.206243 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d0964c53-90c0-4811-968e-2964ad762214 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:57.224629 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d0964c53-90c0-4811-968e-2964ad762214 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:57.228528 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d0964c53-90c0-4811-968e-2964ad762214 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:57.230895 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d0964c53-90c0-4811-968e-2964ad762214 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1810 microversion: 2.20 time: 0.279291 Jan 05 15:02:57.231677 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 278/543] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:56 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1810 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:57.515693 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f53f4257-2b01-4bb9-8e89-6fc790b82623 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:57.523073 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f53f4257-2b01-4bb9-8e89-6fc790b82623 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1675 microversion: 2.1 time: 0.566469 Jan 05 15:02:57.535207 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 266/544] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:56 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1675 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:02:57.675764 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b3a6fa07-966f-4368-9ebd-c76ff441eada tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-456919816", "imageRef": "e4c11159-1e41-437a-af97-eb5f10704ae6", "flavorRef": "452"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:02:57.972025 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-b3a6fa07-966f-4368-9ebd-c76ff441eada tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 15:02:58.056098 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1a509def-14df-49ae-bbc3-e096dd4f7821 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Action: 'create', calling method: .version_select at 0x7f2172489af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1383600894"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:02:58.080867 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-1a509def-14df-49ae-bbc3-e096dd4f7821 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Getting quotas for project b874b608d2c848a88541148e56d2114d. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:02:58.085869 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-1a509def-14df-49ae-bbc3-e096dd4f7821 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Getting quotas for user 036ba058101541b891732f6d9591c876 and project b874b608d2c848a88541148e56d2114d. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:02:58.275229 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-1a509def-14df-49ae-bbc3-e096dd4f7821 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Getting quotas for project b874b608d2c848a88541148e56d2114d. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:02:58.284441 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-1a509def-14df-49ae-bbc3-e096dd4f7821 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Getting quotas for user 036ba058101541b891732f6d9591c876 and project b874b608d2c848a88541148e56d2114d. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:02:58.303899 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1a509def-14df-49ae-bbc3-e096dd4f7821 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.256832 Jan 05 15:02:58.305190 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 267/545] 10.222.0.30 () {60 vars in 1157 bytes} [Wed Jan 5 15:02:58 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:02:58.330550 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f251c696-7ea4-4ce5-a1d3-2cbe71635dcd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:58.331219 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f251c696-7ea4-4ce5-a1d3-2cbe71635dcd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:58.338445 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f251c696-7ea4-4ce5-a1d3-2cbe71635dcd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:58.339185 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f251c696-7ea4-4ce5-a1d3-2cbe71635dcd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:58.340132 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f251c696-7ea4-4ce5-a1d3-2cbe71635dcd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:58.341178 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f251c696-7ea4-4ce5-a1d3-2cbe71635dcd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:58.614360 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f251c696-7ea4-4ce5-a1d3-2cbe71635dcd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:58.628467 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f251c696-7ea4-4ce5-a1d3-2cbe71635dcd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:58.630327 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f251c696-7ea4-4ce5-a1d3-2cbe71635dcd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:58.631540 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f251c696-7ea4-4ce5-a1d3-2cbe71635dcd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1797 microversion: 2.20 time: 0.325076 Jan 05 15:02:58.646625 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 268/546] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:02:58 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1797 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:02:58.646625 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-73f956c8-3c54-4eba-a5c2-376d5790e320 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1067869717", "imageRef": "61127746-a45e-42e9-8a2c-c29d802a5fde", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1383600894", "networks": [{"uuid": "88c2382a-d403-4004-b3bd-23c5e1ff004f"}]}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:02:58.715859 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.network.neutron [None req-73f956c8-3c54-4eba-a5c2-376d5790e320 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] validate_networks() for [('88c2382a-d403-4004-b3bd-23c5e1ff004f', None, None, None, None, None)] {{(pid=128789) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 15:02:58.771436 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b3a6fa07-966f-4368-9ebd-c76ff441eada tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 15:02:58.772483 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b3a6fa07-966f-4368-9ebd-c76ff441eada tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 15:02:58.773257 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b3a6fa07-966f-4368-9ebd-c76ff441eada tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 15:02:58.773902 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b3a6fa07-966f-4368-9ebd-c76ff441eada tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 15:02:58.774618 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b3a6fa07-966f-4368-9ebd-c76ff441eada tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 15:02:58.804000 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3a6fa07-966f-4368-9ebd-c76ff441eada tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:58.804749 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3a6fa07-966f-4368-9ebd-c76ff441eada tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:58.806417 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3a6fa07-966f-4368-9ebd-c76ff441eada tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:58.807177 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3a6fa07-966f-4368-9ebd-c76ff441eada tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:58.837220 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-b3a6fa07-966f-4368-9ebd-c76ff441eada tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Getting quotas for project 27614f6e32454ccaa602817f1658ac5a. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:02:58.844251 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-b3a6fa07-966f-4368-9ebd-c76ff441eada tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Getting quotas for user 834a19c6c1e9406fb4adc38f0b13d021 and project 27614f6e32454ccaa602817f1658ac5a. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:02:58.863543 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b3a6fa07-966f-4368-9ebd-c76ff441eada tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 15:02:58.866886 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b3a6fa07-966f-4368-9ebd-c76ff441eada tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4c11159-1e41-437a-af97-eb5f10704ae6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 15:02:59.021341 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b3a6fa07-966f-4368-9ebd-c76ff441eada tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.349222 Jan 05 15:02:59.022355 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 279/547] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 15:02:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 15:02:59.026736 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-300639b4-181c-4846-b3de-d452b3b35bf7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:59.027634 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-300639b4-181c-4846-b3de-d452b3b35bf7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:59.036773 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-300639b4-181c-4846-b3de-d452b3b35bf7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:59.040385 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-300639b4-181c-4846-b3de-d452b3b35bf7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:59.040385 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-300639b4-181c-4846-b3de-d452b3b35bf7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:59.040385 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-300639b4-181c-4846-b3de-d452b3b35bf7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:59.216484 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-300639b4-181c-4846-b3de-d452b3b35bf7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:59.224891 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-300639b4-181c-4846-b3de-d452b3b35bf7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1652 microversion: 2.1 time: 0.201530 Jan 05 15:02:59.225686 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 280/548] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:59 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1652 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:59.238368 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-78e5eded-eb37-44d9-8793-c2a378d7c86b tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:59.238973 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-78e5eded-eb37-44d9-8793-c2a378d7c86b tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:59.294608 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-78e5eded-eb37-44d9-8793-c2a378d7c86b tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:59.301396 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-78e5eded-eb37-44d9-8793-c2a378d7c86b tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1214 microversion: 2.1 time: 0.074476 Jan 05 15:02:59.301957 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 281/549] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:59 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:02:59.308488 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ddb4d2bd-2696-43e2-a176-23022d3c5496 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:02:59.315367 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ddb4d2bd-2696-43e2-a176-23022d3c5496 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:59.316060 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ddb4d2bd-2696-43e2-a176-23022d3c5496 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:59.339339 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ddb4d2bd-2696-43e2-a176-23022d3c5496 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Going to try to start instance {{(pid=128788) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 05 15:02:59.496719 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ddb4d2bd-2696-43e2-a176-23022d3c5496 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action" status: 202 len: 0 microversion: 2.1 time: 0.193391 Jan 05 15:02:59.497377 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 282/550] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:02:59 2022] POST /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:02:59.510505 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b09d9851-f84a-433d-b044-dab31fbdcb88 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:59.510505 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b09d9851-f84a-433d-b044-dab31fbdcb88 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:59.513173 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b09d9851-f84a-433d-b044-dab31fbdcb88 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:59.513826 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b09d9851-f84a-433d-b044-dab31fbdcb88 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:59.514632 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b09d9851-f84a-433d-b044-dab31fbdcb88 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:59.515069 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b09d9851-f84a-433d-b044-dab31fbdcb88 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:59.660055 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-73f956c8-3c54-4eba-a5c2-376d5790e320 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Flavor limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 15:02:59.660516 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-73f956c8-3c54-4eba-a5c2-376d5790e320 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Image limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 15:02:59.660943 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-73f956c8-3c54-4eba-a5c2-376d5790e320 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Flavor pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 15:02:59.661364 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-73f956c8-3c54-4eba-a5c2-376d5790e320 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Image pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 15:02:59.661796 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-73f956c8-3c54-4eba-a5c2-376d5790e320 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 15:02:59.675038 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-73f956c8-3c54-4eba-a5c2-376d5790e320 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:59.675858 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-73f956c8-3c54-4eba-a5c2-376d5790e320 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:59.676965 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-73f956c8-3c54-4eba-a5c2-376d5790e320 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:02:59.677504 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-73f956c8-3c54-4eba-a5c2-376d5790e320 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:02:59.694893 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b09d9851-f84a-433d-b044-dab31fbdcb88 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:59.696440 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-73f956c8-3c54-4eba-a5c2-376d5790e320 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Getting quotas for project b874b608d2c848a88541148e56d2114d. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:02:59.701739 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-73f956c8-3c54-4eba-a5c2-376d5790e320 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Getting quotas for user 036ba058101541b891732f6d9591c876 and project b874b608d2c848a88541148e56d2114d. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:02:59.712973 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-73f956c8-3c54-4eba-a5c2-376d5790e320 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Going to run 1 instances... {{(pid=128789) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 15:02:59.715360 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-73f956c8-3c54-4eba-a5c2-376d5790e320 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61127746-a45e-42e9-8a2c-c29d802a5fde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 15:02:59.718928 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b09d9851-f84a-433d-b044-dab31fbdcb88 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1661 microversion: 2.1 time: 0.216679 Jan 05 15:02:59.719526 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 283/551] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:59 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1661 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:02:59.850342 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-73f956c8-3c54-4eba-a5c2-376d5790e320 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.216829 Jan 05 15:02:59.856246 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 269/552] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 15:02:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 15:02:59.861446 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3a4fa523-43a2-47db-a141-f5e312898197 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:02:59.862276 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3a4fa523-43a2-47db-a141-f5e312898197 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:02:59.964608 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3a4fa523-43a2-47db-a141-f5e312898197 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:02:59.978430 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3a4fa523-43a2-47db-a141-f5e312898197 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1259 microversion: 2.1 time: 0.121047 Jan 05 15:02:59.981854 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 284/553] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:02:59 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1259 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:00.319517 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2c617277-74a0-48f7-a612-ddb0399b088d tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:00.320757 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2c617277-74a0-48f7-a612-ddb0399b088d tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:00.329380 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2c617277-74a0-48f7-a612-ddb0399b088d tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:00.330070 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2c617277-74a0-48f7-a612-ddb0399b088d tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:00.331971 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2c617277-74a0-48f7-a612-ddb0399b088d tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:00.332679 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2c617277-74a0-48f7-a612-ddb0399b088d tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:00.447009 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-2c617277-74a0-48f7-a612-ddb0399b088d tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:00.471692 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2c617277-74a0-48f7-a612-ddb0399b088d tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1218 microversion: 2.1 time: 0.154375 Jan 05 15:03:00.474557 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 270/554] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:00 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1218 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:00.736744 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b519c4bd-8eae-4b14-ac32-a9db571e4b38 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:00.738022 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b519c4bd-8eae-4b14-ac32-a9db571e4b38 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:00.745683 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b519c4bd-8eae-4b14-ac32-a9db571e4b38 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:00.746431 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b519c4bd-8eae-4b14-ac32-a9db571e4b38 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:00.747595 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b519c4bd-8eae-4b14-ac32-a9db571e4b38 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:00.748193 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b519c4bd-8eae-4b14-ac32-a9db571e4b38 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:00.901476 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b519c4bd-8eae-4b14-ac32-a9db571e4b38 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:00.909665 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b519c4bd-8eae-4b14-ac32-a9db571e4b38 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1661 microversion: 2.1 time: 0.177420 Jan 05 15:03:00.910235 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 285/555] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:00 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1661 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:01.002683 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-78355580-7ab7-40c1-9b0c-794b5823aa40 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:01.003298 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-78355580-7ab7-40c1-9b0c-794b5823aa40 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:01.068384 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-78355580-7ab7-40c1-9b0c-794b5823aa40 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:01.075131 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-78355580-7ab7-40c1-9b0c-794b5823aa40 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1259 microversion: 2.1 time: 0.076127 Jan 05 15:03:01.075715 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 271/556] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:00 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1259 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:01.488718 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e041fff9-4b9a-4500-8163-b1daca1c2c05 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:01.489392 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e041fff9-4b9a-4500-8163-b1daca1c2c05 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:01.500520 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e041fff9-4b9a-4500-8163-b1daca1c2c05 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:01.501240 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e041fff9-4b9a-4500-8163-b1daca1c2c05 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:01.502171 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e041fff9-4b9a-4500-8163-b1daca1c2c05 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:01.502510 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e041fff9-4b9a-4500-8163-b1daca1c2c05 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:01.572797 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e041fff9-4b9a-4500-8163-b1daca1c2c05 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:01.583537 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e041fff9-4b9a-4500-8163-b1daca1c2c05 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1266 microversion: 2.1 time: 0.098972 Jan 05 15:03:01.584599 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 286/557] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:01 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:01.927401 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d391a9b1-d5ce-4921-837e-495d7782c0c0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:01.928085 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d391a9b1-d5ce-4921-837e-495d7782c0c0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:01.938539 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d391a9b1-d5ce-4921-837e-495d7782c0c0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:01.939626 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d391a9b1-d5ce-4921-837e-495d7782c0c0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:01.941346 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d391a9b1-d5ce-4921-837e-495d7782c0c0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:01.941429 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d391a9b1-d5ce-4921-837e-495d7782c0c0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:02.094338 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-970c4083-ebf7-4437-a89f-36e1a5292813 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:02.098911 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-970c4083-ebf7-4437-a89f-36e1a5292813 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:02.111571 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-970c4083-ebf7-4437-a89f-36e1a5292813 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:02.112279 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-970c4083-ebf7-4437-a89f-36e1a5292813 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:02.113292 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-970c4083-ebf7-4437-a89f-36e1a5292813 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:02.113876 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-970c4083-ebf7-4437-a89f-36e1a5292813 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:02.258774 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d391a9b1-d5ce-4921-837e-495d7782c0c0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:02.268204 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d391a9b1-d5ce-4921-837e-495d7782c0c0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1665 microversion: 2.1 time: 0.343118 Jan 05 15:03:02.285500 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 272/558] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:01 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1665 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:02.289753 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-970c4083-ebf7-4437-a89f-36e1a5292813 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:02.298920 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-970c4083-ebf7-4437-a89f-36e1a5292813 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1255 microversion: 2.1 time: 0.209298 Jan 05 15:03:02.312428 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 287/559] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:02 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1255 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:02.614332 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1822d565-9b86-454d-8389-12751ce33f30 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:02.615968 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1822d565-9b86-454d-8389-12751ce33f30 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:02.632543 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1822d565-9b86-454d-8389-12751ce33f30 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:02.636472 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1822d565-9b86-454d-8389-12751ce33f30 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:02.636472 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1822d565-9b86-454d-8389-12751ce33f30 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:02.638605 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1822d565-9b86-454d-8389-12751ce33f30 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:02.714713 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-1822d565-9b86-454d-8389-12751ce33f30 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:02.724535 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1822d565-9b86-454d-8389-12751ce33f30 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1272 microversion: 2.1 time: 0.120418 Jan 05 15:03:02.734663 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 273/560] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:02 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1272 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:03.319928 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e1cbf301-b3cd-4144-8f17-b848d3c9136d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:03.320546 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e1cbf301-b3cd-4144-8f17-b848d3c9136d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:03.331391 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1cbf301-b3cd-4144-8f17-b848d3c9136d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:03.331887 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1cbf301-b3cd-4144-8f17-b848d3c9136d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:03.332745 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1cbf301-b3cd-4144-8f17-b848d3c9136d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:03.333208 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1cbf301-b3cd-4144-8f17-b848d3c9136d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:03.429894 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e1cbf301-b3cd-4144-8f17-b848d3c9136d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:03.443507 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e1cbf301-b3cd-4144-8f17-b848d3c9136d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1319 microversion: 2.1 time: 0.125331 Jan 05 15:03:03.445936 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 288/561] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:03 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1319 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:03.747540 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7f3d4868-62e9-4f71-b127-6a701e2acd07 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:03.748779 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7f3d4868-62e9-4f71-b127-6a701e2acd07 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:03.763867 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7f3d4868-62e9-4f71-b127-6a701e2acd07 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:03.764461 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7f3d4868-62e9-4f71-b127-6a701e2acd07 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:03.765910 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7f3d4868-62e9-4f71-b127-6a701e2acd07 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:03.766287 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7f3d4868-62e9-4f71-b127-6a701e2acd07 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:03.951371 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-7f3d4868-62e9-4f71-b127-6a701e2acd07 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:03.962925 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7f3d4868-62e9-4f71-b127-6a701e2acd07 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1314 microversion: 2.1 time: 0.218162 Jan 05 15:03:03.971694 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 274/562] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:03 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:04.466218 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6e5d8b56-b211-48b5-882e-81caf9dcbcc4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:04.466955 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6e5d8b56-b211-48b5-882e-81caf9dcbcc4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:04.476592 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e5d8b56-b211-48b5-882e-81caf9dcbcc4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:04.477331 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e5d8b56-b211-48b5-882e-81caf9dcbcc4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:04.479712 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e5d8b56-b211-48b5-882e-81caf9dcbcc4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:04.480343 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e5d8b56-b211-48b5-882e-81caf9dcbcc4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:04.668129 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6e5d8b56-b211-48b5-882e-81caf9dcbcc4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:04.678974 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6e5d8b56-b211-48b5-882e-81caf9dcbcc4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1317 microversion: 2.1 time: 0.219258 Jan 05 15:03:04.684679 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 289/563] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:04 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:04.978171 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d9628ae9-0eab-4d1b-b84e-2c4c798d92b1 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:04.978789 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d9628ae9-0eab-4d1b-b84e-2c4c798d92b1 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:04.995219 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d9628ae9-0eab-4d1b-b84e-2c4c798d92b1 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:04.995966 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d9628ae9-0eab-4d1b-b84e-2c4c798d92b1 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:04.999218 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d9628ae9-0eab-4d1b-b84e-2c4c798d92b1 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:05.003789 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d9628ae9-0eab-4d1b-b84e-2c4c798d92b1 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:05.713543 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a2228c44-3a9d-42a8-9af0-7c1cd4825621 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:05.713543 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a2228c44-3a9d-42a8-9af0-7c1cd4825621 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:05.727326 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2228c44-3a9d-42a8-9af0-7c1cd4825621 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:05.727786 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2228c44-3a9d-42a8-9af0-7c1cd4825621 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:05.728585 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2228c44-3a9d-42a8-9af0-7c1cd4825621 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:05.735087 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2228c44-3a9d-42a8-9af0-7c1cd4825621 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:05.908738 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d9628ae9-0eab-4d1b-b84e-2c4c798d92b1 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:05.938931 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d9628ae9-0eab-4d1b-b84e-2c4c798d92b1 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1314 microversion: 2.1 time: 0.942955 Jan 05 15:03:05.943981 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 275/564] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:04 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1314 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:05.962167 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-03015b8b-4cbb-4b61-a41f-29f012778990 req-632ca233-e109-4c8f-8cb8-f9bd112ee50a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d886f950-f714-4343-a8f9-7b22b8b21047", "tag": "c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:03:05.972796 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:05.972796 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:03:05.995082 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-03015b8b-4cbb-4b61-a41f-29f012778990 req-632ca233-e109-4c8f-8cb8-f9bd112ee50a service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:05.995737 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-03015b8b-4cbb-4b61-a41f-29f012778990 req-632ca233-e109-4c8f-8cb8-f9bd112ee50a service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:06.041940 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-03015b8b-4cbb-4b61-a41f-29f012778990 req-632ca233-e109-4c8f-8cb8-f9bd112ee50a service nova] Creating event network-changed:c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 for instance d886f950-f714-4343-a8f9-7b22b8b21047 on hv-cinder-maste Jan 05 15:03:06.061250 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-03015b8b-4cbb-4b61-a41f-29f012778990 req-632ca233-e109-4c8f-8cb8-f9bd112ee50a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115397 Jan 05 15:03:06.065645 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 276/565] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:03:06.463128 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a2228c44-3a9d-42a8-9af0-7c1cd4825621 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:06.471850 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a2228c44-3a9d-42a8-9af0-7c1cd4825621 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1359 microversion: 2.1 time: 0.769295 Jan 05 15:03:06.477710 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 290/566] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:05 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1359 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:06.961449 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-de0658cf-a5d9-403e-b385-76c1a832df0a tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:06.962471 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-de0658cf-a5d9-403e-b385-76c1a832df0a tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:06.977719 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-de0658cf-a5d9-403e-b385-76c1a832df0a tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:06.981286 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-de0658cf-a5d9-403e-b385-76c1a832df0a tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:06.983042 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-de0658cf-a5d9-403e-b385-76c1a832df0a tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:06.986555 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-de0658cf-a5d9-403e-b385-76c1a832df0a tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:07.497458 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4eae43aa-7902-4798-97d7-35f6db48f679 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:07.498080 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4eae43aa-7902-4798-97d7-35f6db48f679 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:07.518797 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eae43aa-7902-4798-97d7-35f6db48f679 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:07.519270 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eae43aa-7902-4798-97d7-35f6db48f679 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:07.524326 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eae43aa-7902-4798-97d7-35f6db48f679 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:07.525017 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eae43aa-7902-4798-97d7-35f6db48f679 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:07.639126 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-de0658cf-a5d9-403e-b385-76c1a832df0a tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:07.652748 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-de0658cf-a5d9-403e-b385-76c1a832df0a tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1314 microversion: 2.1 time: 0.698583 Jan 05 15:03:07.656501 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 277/567] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:06 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:07.904045 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4eae43aa-7902-4798-97d7-35f6db48f679 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:07.913595 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4eae43aa-7902-4798-97d7-35f6db48f679 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1359 microversion: 2.1 time: 0.422107 Jan 05 15:03:07.929467 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 291/568] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:07 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1359 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:08.260430 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-19e1d0c8-8100-48d0-aa90-d4f2671cc819 req-e28e2537-ceda-4eae-b78e-93a95f488a5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:03:08.263028 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:08.263028 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:03:08.285336 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-19e1d0c8-8100-48d0-aa90-d4f2671cc819 req-e28e2537-ceda-4eae-b78e-93a95f488a5a service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:08.287606 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-19e1d0c8-8100-48d0-aa90-d4f2671cc819 req-e28e2537-ceda-4eae-b78e-93a95f488a5a service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:08.326466 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-19e1d0c8-8100-48d0-aa90-d4f2671cc819 req-e28e2537-ceda-4eae-b78e-93a95f488a5a service nova] Creating event network-changed:4bda96b8-bc6e-4586-8d4d-5a66846e4b96 for instance 22497ce1-6400-4f16-a962-dce627a97693 on hv-cinder-maste Jan 05 15:03:08.346101 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-19e1d0c8-8100-48d0-aa90-d4f2671cc819 req-e28e2537-ceda-4eae-b78e-93a95f488a5a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088053 Jan 05 15:03:08.349176 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 278/569] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:03:08.670735 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80079fdd-3047-439f-a9dc-0c132c3753a7 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:08.672945 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-80079fdd-3047-439f-a9dc-0c132c3753a7 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:08.685875 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80079fdd-3047-439f-a9dc-0c132c3753a7 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:08.686733 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80079fdd-3047-439f-a9dc-0c132c3753a7 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:08.687555 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80079fdd-3047-439f-a9dc-0c132c3753a7 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:08.688140 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80079fdd-3047-439f-a9dc-0c132c3753a7 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:08.933916 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-aa4ee87d-8cf5-4b71-9253-05fe847c5e64 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:08.936325 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-aa4ee87d-8cf5-4b71-9253-05fe847c5e64 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:08.952258 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-aa4ee87d-8cf5-4b71-9253-05fe847c5e64 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:08.952916 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-aa4ee87d-8cf5-4b71-9253-05fe847c5e64 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:08.953928 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-aa4ee87d-8cf5-4b71-9253-05fe847c5e64 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:08.954519 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-aa4ee87d-8cf5-4b71-9253-05fe847c5e64 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:09.228959 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-80079fdd-3047-439f-a9dc-0c132c3753a7 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:09.245900 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-80079fdd-3047-439f-a9dc-0c132c3753a7 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1314 microversion: 2.1 time: 0.573835 Jan 05 15:03:09.250598 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 292/570] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:08 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:09.544067 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-aa4ee87d-8cf5-4b71-9253-05fe847c5e64 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:09.574865 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-aa4ee87d-8cf5-4b71-9253-05fe847c5e64 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1359 microversion: 2.1 time: 0.646584 Jan 05 15:03:09.575469 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 279/571] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:08 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1359 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:10.267650 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-21424513-0484-4dfb-a4e4-9ce401572cb6 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:10.268420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-21424513-0484-4dfb-a4e4-9ce401572cb6 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:10.282133 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21424513-0484-4dfb-a4e4-9ce401572cb6 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:10.285706 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21424513-0484-4dfb-a4e4-9ce401572cb6 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:10.286826 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21424513-0484-4dfb-a4e4-9ce401572cb6 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:10.287646 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21424513-0484-4dfb-a4e4-9ce401572cb6 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:10.593442 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-5dc5f4ac-53ea-4af4-a3fe-b9845dfac79a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:10.594295 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-5dc5f4ac-53ea-4af4-a3fe-b9845dfac79a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:10.604642 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5dc5f4ac-53ea-4af4-a3fe-b9845dfac79a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:10.604642 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5dc5f4ac-53ea-4af4-a3fe-b9845dfac79a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:10.604642 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5dc5f4ac-53ea-4af4-a3fe-b9845dfac79a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:10.614553 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-21424513-0484-4dfb-a4e4-9ce401572cb6 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:10.617640 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5dc5f4ac-53ea-4af4-a3fe-b9845dfac79a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:10.626544 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-21424513-0484-4dfb-a4e4-9ce401572cb6 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1314 microversion: 2.1 time: 0.366754 Jan 05 15:03:10.636639 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 293/572] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:10 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:11.200363 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-5dc5f4ac-53ea-4af4-a3fe-b9845dfac79a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:11.215323 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-5dc5f4ac-53ea-4af4-a3fe-b9845dfac79a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1359 microversion: 2.1 time: 0.627227 Jan 05 15:03:11.219036 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 280/573] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:10 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1359 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:11.643622 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56b500a3-056f-4551-9ffb-1c8b1e4c7bfe tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:11.644283 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-56b500a3-056f-4551-9ffb-1c8b1e4c7bfe tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:11.656685 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56b500a3-056f-4551-9ffb-1c8b1e4c7bfe tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:11.657470 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56b500a3-056f-4551-9ffb-1c8b1e4c7bfe tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:11.658652 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56b500a3-056f-4551-9ffb-1c8b1e4c7bfe tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:11.659326 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56b500a3-056f-4551-9ffb-1c8b1e4c7bfe tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:11.825944 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-56b500a3-056f-4551-9ffb-1c8b1e4c7bfe tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:11.834236 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-56b500a3-056f-4551-9ffb-1c8b1e4c7bfe tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1314 microversion: 2.1 time: 0.194804 Jan 05 15:03:11.835746 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 294/574] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:11 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:12.235072 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a9157785-5a3e-47c6-a741-5706bfb4aefe tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:12.235689 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a9157785-5a3e-47c6-a741-5706bfb4aefe tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:12.242963 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a9157785-5a3e-47c6-a741-5706bfb4aefe tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:12.243496 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a9157785-5a3e-47c6-a741-5706bfb4aefe tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:12.244344 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a9157785-5a3e-47c6-a741-5706bfb4aefe tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:12.244778 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a9157785-5a3e-47c6-a741-5706bfb4aefe tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:12.785673 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a9157785-5a3e-47c6-a741-5706bfb4aefe tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:12.797884 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a9157785-5a3e-47c6-a741-5706bfb4aefe tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1359 microversion: 2.1 time: 0.566467 Jan 05 15:03:12.802709 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 281/575] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:12 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1359 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:12.858742 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6b78f593-52e5-4986-847f-aeac2d13336f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:12.859980 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6b78f593-52e5-4986-847f-aeac2d13336f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:12.870802 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b78f593-52e5-4986-847f-aeac2d13336f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:12.872118 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b78f593-52e5-4986-847f-aeac2d13336f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:12.873913 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b78f593-52e5-4986-847f-aeac2d13336f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:12.875048 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b78f593-52e5-4986-847f-aeac2d13336f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:13.080045 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6b78f593-52e5-4986-847f-aeac2d13336f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:13.090090 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6b78f593-52e5-4986-847f-aeac2d13336f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1314 microversion: 2.1 time: 0.240384 Jan 05 15:03:13.097364 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 295/576] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:12 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:13.822090 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1cffb7c0-faea-4ae5-9c3f-3959d0de4b52 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:13.823163 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1cffb7c0-faea-4ae5-9c3f-3959d0de4b52 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:13.832188 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1cffb7c0-faea-4ae5-9c3f-3959d0de4b52 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:13.833013 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1cffb7c0-faea-4ae5-9c3f-3959d0de4b52 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:13.834300 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1cffb7c0-faea-4ae5-9c3f-3959d0de4b52 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:13.834962 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1cffb7c0-faea-4ae5-9c3f-3959d0de4b52 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:14.123556 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8b73b0c9-0bb1-436a-a96e-cdd4eeae3c09 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:14.123556 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8b73b0c9-0bb1-436a-a96e-cdd4eeae3c09 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:14.127086 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b73b0c9-0bb1-436a-a96e-cdd4eeae3c09 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:14.127548 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b73b0c9-0bb1-436a-a96e-cdd4eeae3c09 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:14.128386 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b73b0c9-0bb1-436a-a96e-cdd4eeae3c09 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:14.128822 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b73b0c9-0bb1-436a-a96e-cdd4eeae3c09 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:14.265281 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-1cffb7c0-faea-4ae5-9c3f-3959d0de4b52 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:14.273718 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1cffb7c0-faea-4ae5-9c3f-3959d0de4b52 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1359 microversion: 2.1 time: 0.456450 Jan 05 15:03:14.282992 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 282/577] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:13 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1359 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:14.340404 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8b73b0c9-0bb1-436a-a96e-cdd4eeae3c09 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:14.360368 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8b73b0c9-0bb1-436a-a96e-cdd4eeae3c09 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1314 microversion: 2.1 time: 0.255297 Jan 05 15:03:14.377395 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 296/578] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:14 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:14.702049 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-cd31cb61-3763-4fb1-86de-202a55334914 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Action: 'create', calling method: .version_select at 0x7f21724dac10>, body: {"keypair": {"name": "tempest-TestShelveInstance-28527698"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:03:14.715390 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-cd31cb61-3763-4fb1-86de-202a55334914 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Getting quotas for project c3797435200949c8a45be6c5b0525dc0. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:03:14.719664 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-cd31cb61-3763-4fb1-86de-202a55334914 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Getting quotas for user f5d3596bbc03474dafde93a63ea3e344 and project c3797435200949c8a45be6c5b0525dc0. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:03:15.112277 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-cd31cb61-3763-4fb1-86de-202a55334914 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Getting quotas for project c3797435200949c8a45be6c5b0525dc0. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:03:15.132829 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-cd31cb61-3763-4fb1-86de-202a55334914 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Getting quotas for user f5d3596bbc03474dafde93a63ea3e344 and project c3797435200949c8a45be6c5b0525dc0. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:03:15.185444 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-cd31cb61-3763-4fb1-86de-202a55334914 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2310 microversion: 2.1 time: 0.725502 Jan 05 15:03:15.191599 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 283/579] 10.222.0.30 () {60 vars in 1157 bytes} [Wed Jan 5 15:03:14 2022] POST /compute/v2.1/os-keypairs => generated 2310 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:15.290328 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fa2292c7-c67d-4dcb-b479-212506b0c63b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:15.291193 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fa2292c7-c67d-4dcb-b479-212506b0c63b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:15.298555 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa2292c7-c67d-4dcb-b479-212506b0c63b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:15.299168 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa2292c7-c67d-4dcb-b479-212506b0c63b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:15.300123 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa2292c7-c67d-4dcb-b479-212506b0c63b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:15.300644 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa2292c7-c67d-4dcb-b479-212506b0c63b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:15.379522 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ff68e8cb-3b91-4217-9fe7-49181a8fe325 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:15.380310 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ff68e8cb-3b91-4217-9fe7-49181a8fe325 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:15.387511 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ff68e8cb-3b91-4217-9fe7-49181a8fe325 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:15.387969 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ff68e8cb-3b91-4217-9fe7-49181a8fe325 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:15.388771 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ff68e8cb-3b91-4217-9fe7-49181a8fe325 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:15.389203 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ff68e8cb-3b91-4217-9fe7-49181a8fe325 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:15.607689 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-fa2292c7-c67d-4dcb-b479-212506b0c63b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:15.621677 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fa2292c7-c67d-4dcb-b479-212506b0c63b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1359 microversion: 2.1 time: 0.335106 Jan 05 15:03:15.622271 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 297/580] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:15 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1359 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:15.736027 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ff68e8cb-3b91-4217-9fe7-49181a8fe325 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:15.755179 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ff68e8cb-3b91-4217-9fe7-49181a8fe325 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1314 microversion: 2.1 time: 0.379312 Jan 05 15:03:15.767924 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 284/581] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:15 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:16.638598 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-030ee7b0-dbbd-40a0-bb08-20eb0356e0f8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:16.639216 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-030ee7b0-dbbd-40a0-bb08-20eb0356e0f8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:16.645662 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-030ee7b0-dbbd-40a0-bb08-20eb0356e0f8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:16.646352 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-030ee7b0-dbbd-40a0-bb08-20eb0356e0f8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:16.647125 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-030ee7b0-dbbd-40a0-bb08-20eb0356e0f8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:16.647564 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-030ee7b0-dbbd-40a0-bb08-20eb0356e0f8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:16.776012 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-896480d7-defb-4685-9e42-b7019cdef7db tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:16.777508 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-896480d7-defb-4685-9e42-b7019cdef7db tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:16.788768 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-896480d7-defb-4685-9e42-b7019cdef7db tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:16.789312 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-896480d7-defb-4685-9e42-b7019cdef7db tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:16.790180 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-896480d7-defb-4685-9e42-b7019cdef7db tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:16.791893 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-896480d7-defb-4685-9e42-b7019cdef7db tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:16.843980 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-030ee7b0-dbbd-40a0-bb08-20eb0356e0f8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:16.856633 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-030ee7b0-dbbd-40a0-bb08-20eb0356e0f8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1359 microversion: 2.1 time: 0.220141 Jan 05 15:03:16.860234 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 298/582] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:16 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:16.874095 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6360c05d-2d19-45df-a900-4e84f790b79a req-12781dcd-4bd5-41bb-a0d3-b5be13d81677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d886f950-f714-4343-a8f9-7b22b8b21047", "name": "network-vif-plugged", "status": "completed", "tag": "c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:03:16.876388 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:16.876388 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:03:16.897460 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6360c05d-2d19-45df-a900-4e84f790b79a req-12781dcd-4bd5-41bb-a0d3-b5be13d81677 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:16.899284 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6360c05d-2d19-45df-a900-4e84f790b79a req-12781dcd-4bd5-41bb-a0d3-b5be13d81677 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:16.921937 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6360c05d-2d19-45df-a900-4e84f790b79a req-12781dcd-4bd5-41bb-a0d3-b5be13d81677 service nova] Creating event network-vif-plugged:c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 for instance d886f950-f714-4343-a8f9-7b22b8b21047 on hv-cinder-maste Jan 05 15:03:16.927979 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6360c05d-2d19-45df-a900-4e84f790b79a req-12781dcd-4bd5-41bb-a0d3-b5be13d81677 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066172 Jan 05 15:03:16.929182 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 299/583] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:03:17.017182 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-896480d7-defb-4685-9e42-b7019cdef7db tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:17.029028 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-896480d7-defb-4685-9e42-b7019cdef7db tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1314 microversion: 2.1 time: 0.256283 Jan 05 15:03:17.030349 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 285/584] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:16 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:17.877534 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-710fd863-b402-4a2f-ba3f-984da4a71d16 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:17.878207 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-710fd863-b402-4a2f-ba3f-984da4a71d16 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:17.884850 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-710fd863-b402-4a2f-ba3f-984da4a71d16 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:17.885325 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-710fd863-b402-4a2f-ba3f-984da4a71d16 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:17.886232 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-710fd863-b402-4a2f-ba3f-984da4a71d16 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:17.886888 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-710fd863-b402-4a2f-ba3f-984da4a71d16 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:18.046977 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-8a664fbc-5bf5-48a2-882b-e79664fde076 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:18.047578 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-8a664fbc-5bf5-48a2-882b-e79664fde076 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:18.058178 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8a664fbc-5bf5-48a2-882b-e79664fde076 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:18.058626 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8a664fbc-5bf5-48a2-882b-e79664fde076 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:18.061533 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8a664fbc-5bf5-48a2-882b-e79664fde076 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:18.061533 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8a664fbc-5bf5-48a2-882b-e79664fde076 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:18.090264 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-710fd863-b402-4a2f-ba3f-984da4a71d16 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:18.128560 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-710fd863-b402-4a2f-ba3f-984da4a71d16 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1359 microversion: 2.1 time: 0.256062 Jan 05 15:03:18.129651 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 300/585] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:17 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1359 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:18.286466 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-8a664fbc-5bf5-48a2-882b-e79664fde076 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:18.291822 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-8a664fbc-5bf5-48a2-882b-e79664fde076 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1314 microversion: 2.1 time: 0.248920 Jan 05 15:03:18.294921 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 286/586] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:18 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:19.153955 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b78c3d3e-3b98-43cd-906e-9f65afd26694 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:19.154556 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b78c3d3e-3b98-43cd-906e-9f65afd26694 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:19.160486 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b78c3d3e-3b98-43cd-906e-9f65afd26694 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:19.160925 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b78c3d3e-3b98-43cd-906e-9f65afd26694 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:19.161766 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b78c3d3e-3b98-43cd-906e-9f65afd26694 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:19.162474 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b78c3d3e-3b98-43cd-906e-9f65afd26694 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:19.300031 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b78c3d3e-3b98-43cd-906e-9f65afd26694 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:19.308726 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b78c3d3e-3b98-43cd-906e-9f65afd26694 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1359 microversion: 2.1 time: 0.158514 Jan 05 15:03:19.313209 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f25fc01e-0113-4461-9c0d-0edaf2e214f8 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:19.314630 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f25fc01e-0113-4461-9c0d-0edaf2e214f8 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:19.319298 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 301/587] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:19 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:19.323114 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f25fc01e-0113-4461-9c0d-0edaf2e214f8 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:19.323624 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f25fc01e-0113-4461-9c0d-0edaf2e214f8 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:19.324531 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f25fc01e-0113-4461-9c0d-0edaf2e214f8 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:19.325056 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f25fc01e-0113-4461-9c0d-0edaf2e214f8 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:19.475807 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f25fc01e-0113-4461-9c0d-0edaf2e214f8 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:19.483987 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f25fc01e-0113-4461-9c0d-0edaf2e214f8 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1463 microversion: 2.1 time: 0.176746 Jan 05 15:03:19.484593 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 287/588] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:19 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1463 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:19.527131 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e354839d-1b6e-40ae-ac8b-8f85c8262348 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:19.527628 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e354839d-1b6e-40ae-ac8b-8f85c8262348 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:19.534074 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e354839d-1b6e-40ae-ac8b-8f85c8262348 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:19.534530 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e354839d-1b6e-40ae-ac8b-8f85c8262348 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:19.535312 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e354839d-1b6e-40ae-ac8b-8f85c8262348 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:19.535949 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e354839d-1b6e-40ae-ac8b-8f85c8262348 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:19.561339 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e354839d-1b6e-40ae-ac8b-8f85c8262348 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:03:20.330440 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-33452581-943b-4d83-ac5e-4c155a3a5b2e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:20.331050 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-33452581-943b-4d83-ac5e-4c155a3a5b2e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:20.337661 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-33452581-943b-4d83-ac5e-4c155a3a5b2e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:20.338107 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-33452581-943b-4d83-ac5e-4c155a3a5b2e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:20.338885 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-33452581-943b-4d83-ac5e-4c155a3a5b2e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:20.339307 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-33452581-943b-4d83-ac5e-4c155a3a5b2e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:20.399895 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e354839d-1b6e-40ae-ac8b-8f85c8262348 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 204 len: 0 microversion: 2.1 time: 0.875690 Jan 05 15:03:20.404596 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 302/589] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:03:19 2022] DELETE /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 0 bytes in 878 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:03:20.409149 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3b83470a-8429-43d9-89ca-badec535d52f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:20.409859 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3b83470a-8429-43d9-89ca-badec535d52f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:20.417028 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b83470a-8429-43d9-89ca-badec535d52f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:20.417621 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b83470a-8429-43d9-89ca-badec535d52f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:20.418474 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b83470a-8429-43d9-89ca-badec535d52f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:20.418704 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b83470a-8429-43d9-89ca-badec535d52f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:20.499711 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-33452581-943b-4d83-ac5e-4c155a3a5b2e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:20.510575 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-33452581-943b-4d83-ac5e-4c155a3a5b2e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1359 microversion: 2.1 time: 0.187099 Jan 05 15:03:20.511160 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 288/590] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:20 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:20.567382 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3b83470a-8429-43d9-89ca-badec535d52f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:20.575580 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3b83470a-8429-43d9-89ca-badec535d52f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1469 microversion: 2.1 time: 0.171038 Jan 05 15:03:20.576360 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 303/591] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:20 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:21.129242 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-be84f337-d154-4715-a66a-d5549d1c06c0 req-8ffc68d2-cf99-4ea4-adad-b3c7cadbcc0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "name": "network-vif-plugged", "status": "completed", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:03:21.130826 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:21.130826 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:03:21.137632 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-be84f337-d154-4715-a66a-d5549d1c06c0 req-8ffc68d2-cf99-4ea4-adad-b3c7cadbcc0c service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:21.138141 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-be84f337-d154-4715-a66a-d5549d1c06c0 req-8ffc68d2-cf99-4ea4-adad-b3c7cadbcc0c service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:21.149939 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-be84f337-d154-4715-a66a-d5549d1c06c0 req-8ffc68d2-cf99-4ea4-adad-b3c7cadbcc0c service nova] Creating event network-vif-plugged:4bda96b8-bc6e-4586-8d4d-5a66846e4b96 for instance 22497ce1-6400-4f16-a962-dce627a97693 on hv-cinder-maste Jan 05 15:03:21.154897 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-be84f337-d154-4715-a66a-d5549d1c06c0 req-8ffc68d2-cf99-4ea4-adad-b3c7cadbcc0c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029334 Jan 05 15:03:21.155485 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 289/592] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:03:21.527391 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6781939b-be43-4d20-8a67-2c95e9e8c1f6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:21.529156 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6781939b-be43-4d20-8a67-2c95e9e8c1f6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:21.535596 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6781939b-be43-4d20-8a67-2c95e9e8c1f6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:21.536061 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6781939b-be43-4d20-8a67-2c95e9e8c1f6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:21.536836 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6781939b-be43-4d20-8a67-2c95e9e8c1f6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:21.537290 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6781939b-be43-4d20-8a67-2c95e9e8c1f6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:21.593504 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-96ac2c39-e3a0-4bff-b8e9-7a41c4a71388 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:21.594978 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-96ac2c39-e3a0-4bff-b8e9-7a41c4a71388 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:21.601191 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96ac2c39-e3a0-4bff-b8e9-7a41c4a71388 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:21.601777 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96ac2c39-e3a0-4bff-b8e9-7a41c4a71388 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:21.602571 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96ac2c39-e3a0-4bff-b8e9-7a41c4a71388 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:21.603032 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96ac2c39-e3a0-4bff-b8e9-7a41c4a71388 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:21.679958 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6781939b-be43-4d20-8a67-2c95e9e8c1f6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:21.688341 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6781939b-be43-4d20-8a67-2c95e9e8c1f6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1359 microversion: 2.1 time: 0.164954 Jan 05 15:03:21.688996 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 304/593] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:21 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:21.734767 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-96ac2c39-e3a0-4bff-b8e9-7a41c4a71388 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:21.742137 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-96ac2c39-e3a0-4bff-b8e9-7a41c4a71388 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1469 microversion: 2.1 time: 0.153569 Jan 05 15:03:21.742696 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 290/594] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:21 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:22.705577 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8508b513-5c2e-4730-958c-a622c703b2d8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:22.706204 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8508b513-5c2e-4730-958c-a622c703b2d8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:22.712543 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8508b513-5c2e-4730-958c-a622c703b2d8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:22.712985 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8508b513-5c2e-4730-958c-a622c703b2d8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:22.713819 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8508b513-5c2e-4730-958c-a622c703b2d8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:22.714245 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8508b513-5c2e-4730-958c-a622c703b2d8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:22.759576 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-9feb3906-f42f-453a-9257-80ba6e14db47 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:22.760137 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-9feb3906-f42f-453a-9257-80ba6e14db47 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:22.767351 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9feb3906-f42f-453a-9257-80ba6e14db47 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:22.767895 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9feb3906-f42f-453a-9257-80ba6e14db47 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:22.768811 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9feb3906-f42f-453a-9257-80ba6e14db47 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:22.769397 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9feb3906-f42f-453a-9257-80ba6e14db47 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:22.848504 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8508b513-5c2e-4730-958c-a622c703b2d8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:22.856135 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8508b513-5c2e-4730-958c-a622c703b2d8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1359 microversion: 2.1 time: 0.154955 Jan 05 15:03:22.856710 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 305/595] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:22 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:22.904122 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-9feb3906-f42f-453a-9257-80ba6e14db47 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:22.911337 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-9feb3906-f42f-453a-9257-80ba6e14db47 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1469 microversion: 2.1 time: 0.155477 Jan 05 15:03:22.911907 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 291/596] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:22 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:23.874621 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cfbdaa51-b7df-4b51-a192-52746270772d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:23.879392 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cfbdaa51-b7df-4b51-a192-52746270772d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:23.892703 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfbdaa51-b7df-4b51-a192-52746270772d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:23.892703 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfbdaa51-b7df-4b51-a192-52746270772d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:23.892703 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfbdaa51-b7df-4b51-a192-52746270772d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:23.892703 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfbdaa51-b7df-4b51-a192-52746270772d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:23.904740 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-1ea80fd4-39c6-4e47-8edb-6b2e6b0a8ed9 req-db703147-382f-4072-999b-a565efec266f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d886f950-f714-4343-a8f9-7b22b8b21047", "name": "network-vif-deleted", "tag": "c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:03:23.906225 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:23.906225 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:03:23.914667 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-1ea80fd4-39c6-4e47-8edb-6b2e6b0a8ed9 req-db703147-382f-4072-999b-a565efec266f service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:23.915216 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-1ea80fd4-39c6-4e47-8edb-6b2e6b0a8ed9 req-db703147-382f-4072-999b-a565efec266f service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:23.930945 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-1ea80fd4-39c6-4e47-8edb-6b2e6b0a8ed9 req-db703147-382f-4072-999b-a565efec266f service nova] Creating event network-vif-deleted:c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 for instance d886f950-f714-4343-a8f9-7b22b8b21047 on hv-cinder-maste Jan 05 15:03:23.938585 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-1ea80fd4-39c6-4e47-8edb-6b2e6b0a8ed9 req-db703147-382f-4072-999b-a565efec266f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037604 Jan 05 15:03:23.939560 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 292/597] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:03:23.946561 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2285b2ee-ad18-407a-be90-5cc8b4624ba1 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:23.947885 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2285b2ee-ad18-407a-be90-5cc8b4624ba1 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:23.961001 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2285b2ee-ad18-407a-be90-5cc8b4624ba1 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:23.961508 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2285b2ee-ad18-407a-be90-5cc8b4624ba1 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:23.962372 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2285b2ee-ad18-407a-be90-5cc8b4624ba1 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:23.962994 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2285b2ee-ad18-407a-be90-5cc8b4624ba1 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:24.040600 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-2285b2ee-ad18-407a-be90-5cc8b4624ba1 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:24.051182 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2285b2ee-ad18-407a-be90-5cc8b4624ba1 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1427 microversion: 2.1 time: 0.109493 Jan 05 15:03:24.051773 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 293/598] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:23 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:24.061191 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-cfbdaa51-b7df-4b51-a192-52746270772d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:24.069674 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cfbdaa51-b7df-4b51-a192-52746270772d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1549 microversion: 2.1 time: 0.201551 Jan 05 15:03:24.070261 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 306/599] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:23 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1549 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:24.085775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2f278b61-f012-4b4b-87f6-c905c004f494 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:24.086408 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2f278b61-f012-4b4b-87f6-c905c004f494 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:24.092360 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2f278b61-f012-4b4b-87f6-c905c004f494 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:24.092840 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2f278b61-f012-4b4b-87f6-c905c004f494 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:24.093807 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2f278b61-f012-4b4b-87f6-c905c004f494 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:24.094268 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2f278b61-f012-4b4b-87f6-c905c004f494 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:24.229913 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-2f278b61-f012-4b4b-87f6-c905c004f494 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:24.237825 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2f278b61-f012-4b4b-87f6-c905c004f494 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1549 microversion: 2.1 time: 0.155669 Jan 05 15:03:24.238404 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 294/600] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:24 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:24.253380 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d5006e1c-e607-4d9d-885e-18d5c1d91f9f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:24.256730 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:24.256730 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:03:24.257724 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d5006e1c-e607-4d9d-885e-18d5c1d91f9f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:24.258457 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d5006e1c-e607-4d9d-885e-18d5c1d91f9f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Searching by: {'deleted': False, 'project_id': 'b874b608d2c848a88541148e56d2114d'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 05 15:03:24.265201 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5006e1c-e607-4d9d-885e-18d5c1d91f9f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:24.265643 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5006e1c-e607-4d9d-885e-18d5c1d91f9f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:24.266436 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5006e1c-e607-4d9d-885e-18d5c1d91f9f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:24.266861 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5006e1c-e607-4d9d-885e-18d5c1d91f9f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:24.358042 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-d5006e1c-e607-4d9d-885e-18d5c1d91f9f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 05 15:03:24.453681 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d5006e1c-e607-4d9d-885e-18d5c1d91f9f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204140 Jan 05 15:03:24.454190 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 307/601] 10.222.0.30 () {58 vars in 1124 bytes} [Wed Jan 5 15:03:24 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:03:24.464742 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f950730f-ce4c-4f5b-b904-d09486888893 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:24.472937 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f950730f-ce4c-4f5b-b904-d09486888893 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:24.472937 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f950730f-ce4c-4f5b-b904-d09486888893 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:24.472937 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f950730f-ce4c-4f5b-b904-d09486888893 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:24.473317 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f950730f-ce4c-4f5b-b904-d09486888893 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:24.473492 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f950730f-ce4c-4f5b-b904-d09486888893 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:24.610826 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f950730f-ce4c-4f5b-b904-d09486888893 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:24.617796 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f950730f-ce4c-4f5b-b904-d09486888893 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1549 microversion: 2.1 time: 0.156773 Jan 05 15:03:24.618365 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 295/602] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:24 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:25.068284 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fbc7d84a-47c9-4e5e-914c-9574d8165154 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:25.068825 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fbc7d84a-47c9-4e5e-914c-9574d8165154 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:25.075095 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc7d84a-47c9-4e5e-914c-9574d8165154 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:25.080332 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc7d84a-47c9-4e5e-914c-9574d8165154 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:25.080332 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc7d84a-47c9-4e5e-914c-9574d8165154 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:25.080332 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc7d84a-47c9-4e5e-914c-9574d8165154 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:25.115890 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc7d84a-47c9-4e5e-914c-9574d8165154 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:25.116340 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc7d84a-47c9-4e5e-914c-9574d8165154 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:25.116784 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-fbc7d84a-47c9-4e5e-914c-9574d8165154 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lazy-loading 'fault' on Instance uuid d886f950-f714-4343-a8f9-7b22b8b21047 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:03:25.167090 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-fbc7d84a-47c9-4e5e-914c-9574d8165154 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834a19c6c1e9406fb4adc38f0b13d021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27614f6e32454ccaa602817f1658ac5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:25.174647 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fbc7d84a-47c9-4e5e-914c-9574d8165154 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 200 len: 1304 microversion: 2.1 time: 0.110115 Jan 05 15:03:25.175450 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 308/603] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:25 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:26.191704 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-10f8d9ba-e15b-49f7-bd4f-a724ad73709f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:26.192292 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-10f8d9ba-e15b-49f7-bd4f-a724ad73709f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] [instance: d886f950-f714-4343-a8f9-7b22b8b21047] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:26.198564 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-10f8d9ba-e15b-49f7-bd4f-a724ad73709f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:26.199085 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-10f8d9ba-e15b-49f7-bd4f-a724ad73709f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:26.199773 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-10f8d9ba-e15b-49f7-bd4f-a724ad73709f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:26.200203 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-10f8d9ba-e15b-49f7-bd4f-a724ad73709f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:26.214072 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-10f8d9ba-e15b-49f7-bd4f-a724ad73709f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] HTTP exception thrown: Instance d886f950-f714-4343-a8f9-7b22b8b21047 could not be found. Jan 05 15:03:26.215785 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-10f8d9ba-e15b-49f7-bd4f-a724ad73709f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Returning 404 to user: Instance d886f950-f714-4343-a8f9-7b22b8b21047 could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:03:26.215785 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-10f8d9ba-e15b-49f7-bd4f-a724ad73709f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047" status: 404 len: 111 microversion: 2.1 time: 0.027595 Jan 05 15:03:26.216063 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 296/604] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:26 2022] GET /compute/v2.1/servers/d886f950-f714-4343-a8f9-7b22b8b21047 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:03:26.911946 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-08be46fb-82cc-428a-a9f3-ca4346ea6c49 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c358bb0-90c9-47f0-9870-959445df1a99"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:03:26.914953 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-08be46fb-82cc-428a-a9f3-ca4346ea6c49 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:26.921825 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08be46fb-82cc-428a-a9f3-ca4346ea6c49 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:26.922577 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08be46fb-82cc-428a-a9f3-ca4346ea6c49 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:26.924312 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08be46fb-82cc-428a-a9f3-ca4346ea6c49 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:26.924927 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08be46fb-82cc-428a-a9f3-ca4346ea6c49 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:28.136706 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-08be46fb-82cc-428a-a9f3-ca4346ea6c49 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "POST /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.229410 Jan 05 15:03:28.137491 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 309/605] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Jan 5 15:03:26 2022] POST /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/os-volume_attachments => generated 194 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:03:36.858589 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-76777fdc-8fd2-4106-81bd-019c124b6ff7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:36.859253 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-76777fdc-8fd2-4106-81bd-019c124b6ff7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:36.865641 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-76777fdc-8fd2-4106-81bd-019c124b6ff7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:36.866093 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-76777fdc-8fd2-4106-81bd-019c124b6ff7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:36.866871 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-76777fdc-8fd2-4106-81bd-019c124b6ff7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:36.867299 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-76777fdc-8fd2-4106-81bd-019c124b6ff7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:37.001378 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-76777fdc-8fd2-4106-81bd-019c124b6ff7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:37.009042 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-76777fdc-8fd2-4106-81bd-019c124b6ff7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1595 microversion: 2.1 time: 0.154669 Jan 05 15:03:37.009625 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 297/606] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:36 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1595 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:37.238933 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b546b629-51e3-45f0-9064-ee4beb85b993 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1299039949", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-28527698", "security_groups": [{"name": "tempest-secgroup-smoke-1412084070"}], "networks": [{"uuid": "e5205e82-a517-4157-848a-78560d0d2806"}], "block_device_mapping_v2": [{"uuid": "97a24ac8-1068-4a4c-8440-2fdcc9913798", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:03:37.344771 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-b546b629-51e3-45f0-9064-ee4beb85b993 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] validate_networks() for [('e5205e82-a517-4157-848a-78560d0d2806', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 15:03:37.706841 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b546b629-51e3-45f0-9064-ee4beb85b993 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 15:03:37.708157 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b546b629-51e3-45f0-9064-ee4beb85b993 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 15:03:37.708157 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b546b629-51e3-45f0-9064-ee4beb85b993 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 15:03:37.708157 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b546b629-51e3-45f0-9064-ee4beb85b993 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 15:03:37.708471 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b546b629-51e3-45f0-9064-ee4beb85b993 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 15:03:37.719612 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b546b629-51e3-45f0-9064-ee4beb85b993 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:37.720214 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b546b629-51e3-45f0-9064-ee4beb85b993 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:37.721397 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b546b629-51e3-45f0-9064-ee4beb85b993 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:37.721983 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b546b629-51e3-45f0-9064-ee4beb85b993 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:37.740445 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-b546b629-51e3-45f0-9064-ee4beb85b993 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Getting quotas for project c3797435200949c8a45be6c5b0525dc0. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:03:37.744604 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-b546b629-51e3-45f0-9064-ee4beb85b993 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Getting quotas for user f5d3596bbc03474dafde93a63ea3e344 and project c3797435200949c8a45be6c5b0525dc0. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:03:37.799088 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b546b629-51e3-45f0-9064-ee4beb85b993 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 15:03:37.802380 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b546b629-51e3-45f0-9064-ee4beb85b993 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97a24ac8-1068-4a4c-8440-2fdcc9913798',volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 15:03:38.357222 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b546b629-51e3-45f0-9064-ee4beb85b993 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.127155 Jan 05 15:03:38.357930 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 310/607] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 15:03:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 15:03:38.367988 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-057c0c97-0065-40cd-98ac-2a5d549d846c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:38.368587 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-057c0c97-0065-40cd-98ac-2a5d549d846c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:38.646220 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-057c0c97-0065-40cd-98ac-2a5d549d846c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:38.652775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-057c0c97-0065-40cd-98ac-2a5d549d846c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1087 microversion: 2.1 time: 0.288357 Jan 05 15:03:38.653482 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 298/608] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:38 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1087 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:39.491460 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7d78717f-94fa-4ea9-bc12-313bc9b5777f req-54315eaa-14a4-4113-9812-b386ff5990c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:03:39.493089 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:39.493089 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:03:39.500467 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7d78717f-94fa-4ea9-bc12-313bc9b5777f req-54315eaa-14a4-4113-9812-b386ff5990c0 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:39.500902 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7d78717f-94fa-4ea9-bc12-313bc9b5777f req-54315eaa-14a4-4113-9812-b386ff5990c0 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:39.513575 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7d78717f-94fa-4ea9-bc12-313bc9b5777f req-54315eaa-14a4-4113-9812-b386ff5990c0 service nova] Creating event network-changed:4bda96b8-bc6e-4586-8d4d-5a66846e4b96 for instance 22497ce1-6400-4f16-a962-dce627a97693 on hv-cinder-maste Jan 05 15:03:39.518710 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7d78717f-94fa-4ea9-bc12-313bc9b5777f req-54315eaa-14a4-4113-9812-b386ff5990c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031431 Jan 05 15:03:39.519670 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 311/609] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:03:39.669934 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-287ef6df-3c38-4a6c-a532-6647c0b21a66 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:39.670561 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-287ef6df-3c38-4a6c-a532-6647c0b21a66 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:39.678046 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-287ef6df-3c38-4a6c-a532-6647c0b21a66 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:39.678489 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-287ef6df-3c38-4a6c-a532-6647c0b21a66 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:39.679264 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-287ef6df-3c38-4a6c-a532-6647c0b21a66 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:39.679695 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-287ef6df-3c38-4a6c-a532-6647c0b21a66 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:39.740017 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-287ef6df-3c38-4a6c-a532-6647c0b21a66 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:39.747250 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-287ef6df-3c38-4a6c-a532-6647c0b21a66 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1137 microversion: 2.1 time: 0.080993 Jan 05 15:03:39.748503 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 299/610] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:39 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1137 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:40.553179 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8fe4b1f5-6a96-4735-9e2c-1a41e8ae5fa4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:40.553179 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8fe4b1f5-6a96-4735-9e2c-1a41e8ae5fa4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:40.559118 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fe4b1f5-6a96-4735-9e2c-1a41e8ae5fa4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:40.559640 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fe4b1f5-6a96-4735-9e2c-1a41e8ae5fa4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:40.560497 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fe4b1f5-6a96-4735-9e2c-1a41e8ae5fa4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:40.560997 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fe4b1f5-6a96-4735-9e2c-1a41e8ae5fa4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:40.592426 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8fe4b1f5-6a96-4735-9e2c-1a41e8ae5fa4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments/9af779f5-e190-4380-b009-1bdb20a4182c" status: 200 len: 194 microversion: 2.20 time: 0.045712 Jan 05 15:03:40.597220 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 312/611] 10.222.0.30 () {60 vars in 1453 bytes} [Wed Jan 5 15:03:40 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments/9af779f5-e190-4380-b009-1bdb20a4182c => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:03:40.690213 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-81f47304-b042-4295-86a1-b24235a892a1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:40.690904 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-81f47304-b042-4295-86a1-b24235a892a1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:40.698086 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-81f47304-b042-4295-86a1-b24235a892a1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:40.698869 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-81f47304-b042-4295-86a1-b24235a892a1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:40.699885 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-81f47304-b042-4295-86a1-b24235a892a1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:40.700529 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-81f47304-b042-4295-86a1-b24235a892a1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:40.765474 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-79142f02-6604-44ed-b51e-9e9a3be48479 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:40.766258 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-79142f02-6604-44ed-b51e-9e9a3be48479 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:40.773576 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79142f02-6604-44ed-b51e-9e9a3be48479 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:40.774401 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79142f02-6604-44ed-b51e-9e9a3be48479 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:40.775593 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79142f02-6604-44ed-b51e-9e9a3be48479 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:40.776778 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79142f02-6604-44ed-b51e-9e9a3be48479 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:40.799229 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-81f47304-b042-4295-86a1-b24235a892a1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lazy-loading 'services' on Instance uuid 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:03:40.860122 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-79142f02-6604-44ed-b51e-9e9a3be48479 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:40.867660 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-79142f02-6604-44ed-b51e-9e9a3be48479 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1129 microversion: 2.1 time: 0.107302 Jan 05 15:03:40.868653 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 313/612] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:40 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1129 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:41.029175 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-81f47304-b042-4295-86a1-b24235a892a1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments/9af779f5-e190-4380-b009-1bdb20a4182c" status: 202 len: 0 microversion: 2.20 time: 0.343200 Jan 05 15:03:41.031415 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 300/613] 10.222.0.30 () {60 vars in 1456 bytes} [Wed Jan 5 15:03:40 2022] DELETE /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments/9af779f5-e190-4380-b009-1bdb20a4182c => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:03:41.037901 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-30522154-1fe3-4e05-b5a3-757079ad928a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:41.038844 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-30522154-1fe3-4e05-b5a3-757079ad928a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:41.045113 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30522154-1fe3-4e05-b5a3-757079ad928a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:41.046734 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30522154-1fe3-4e05-b5a3-757079ad928a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:41.048000 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30522154-1fe3-4e05-b5a3-757079ad928a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:41.048000 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30522154-1fe3-4e05-b5a3-757079ad928a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:41.079611 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-30522154-1fe3-4e05-b5a3-757079ad928a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045351 Jan 05 15:03:41.080093 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 314/614] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Jan 5 15:03:41 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:03:41.343473 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-516407f2-dec2-4289-b749-97b9e7a4a5aa tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:41.344524 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-516407f2-dec2-4289-b749-97b9e7a4a5aa tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:41.351061 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-516407f2-dec2-4289-b749-97b9e7a4a5aa tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:41.351518 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-516407f2-dec2-4289-b749-97b9e7a4a5aa tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:41.352309 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-516407f2-dec2-4289-b749-97b9e7a4a5aa tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:41.352748 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-516407f2-dec2-4289-b749-97b9e7a4a5aa tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:41.387906 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-516407f2-dec2-4289-b749-97b9e7a4a5aa tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048465 Jan 05 15:03:41.388728 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 301/615] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:03:41 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:03:41.446171 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3f04b827-2208-4711-b049-11bd1066109f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:41.446738 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3f04b827-2208-4711-b049-11bd1066109f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:41.452804 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f04b827-2208-4711-b049-11bd1066109f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:41.453516 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f04b827-2208-4711-b049-11bd1066109f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:41.454519 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f04b827-2208-4711-b049-11bd1066109f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:41.455014 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f04b827-2208-4711-b049-11bd1066109f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:41.484647 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3f04b827-2208-4711-b049-11bd1066109f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:03:41.885379 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-31cc2d28-22e0-46c5-9a3c-1212ece39d45 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:41.886091 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-31cc2d28-22e0-46c5-9a3c-1212ece39d45 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:41.892865 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-31cc2d28-22e0-46c5-9a3c-1212ece39d45 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:41.893472 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-31cc2d28-22e0-46c5-9a3c-1212ece39d45 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:41.894256 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-31cc2d28-22e0-46c5-9a3c-1212ece39d45 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:41.894689 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-31cc2d28-22e0-46c5-9a3c-1212ece39d45 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:41.905805 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3f04b827-2208-4711-b049-11bd1066109f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 204 len: 0 microversion: 2.1 time: 0.461776 Jan 05 15:03:41.911038 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 315/616] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:03:41 2022] DELETE /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:03:41.924856 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9ec01fda-18cd-4730-8aac-afe79a704622 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:41.926717 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9ec01fda-18cd-4730-8aac-afe79a704622 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:41.933891 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ec01fda-18cd-4730-8aac-afe79a704622 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:41.934596 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ec01fda-18cd-4730-8aac-afe79a704622 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:41.935615 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ec01fda-18cd-4730-8aac-afe79a704622 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:41.936065 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ec01fda-18cd-4730-8aac-afe79a704622 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:41.981626 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-31cc2d28-22e0-46c5-9a3c-1212ece39d45 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:41.992451 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-31cc2d28-22e0-46c5-9a3c-1212ece39d45 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1193 microversion: 2.1 time: 0.110641 Jan 05 15:03:41.993261 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 302/617] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:41 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1193 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:42.090466 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3d631d4c-ad1a-4fd7-bdeb-4ef4be2fbdf3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:42.091356 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3d631d4c-ad1a-4fd7-bdeb-4ef4be2fbdf3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:42.097675 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-9ec01fda-18cd-4730-8aac-afe79a704622 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:42.098404 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3d631d4c-ad1a-4fd7-bdeb-4ef4be2fbdf3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:42.098923 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3d631d4c-ad1a-4fd7-bdeb-4ef4be2fbdf3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:42.099711 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3d631d4c-ad1a-4fd7-bdeb-4ef4be2fbdf3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:42.100143 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3d631d4c-ad1a-4fd7-bdeb-4ef4be2fbdf3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:42.105182 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9ec01fda-18cd-4730-8aac-afe79a704622 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1671 microversion: 2.1 time: 0.189302 Jan 05 15:03:42.105746 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 316/618] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:41 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1671 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:42.130751 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3d631d4c-ad1a-4fd7-bdeb-4ef4be2fbdf3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043996 Jan 05 15:03:42.131319 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 303/619] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Jan 5 15:03:42 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:03:42.273398 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1780740953"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:03:42.273398 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:42.279322 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:42.279757 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:42.280700 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:42.281145 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:42.490946 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.network.security_group_api [None req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Adding security group 2767f584-b06b-4dab-a69f-33162778019e to port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 Jan 05 15:03:43.009354 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f4d5df4e-8609-49f7-b8c9-8c2b445b9623 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:43.010140 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f4d5df4e-8609-49f7-b8c9-8c2b445b9623 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:43.016897 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f4d5df4e-8609-49f7-b8c9-8c2b445b9623 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:43.017375 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f4d5df4e-8609-49f7-b8c9-8c2b445b9623 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:43.018159 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f4d5df4e-8609-49f7-b8c9-8c2b445b9623 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:43.018597 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f4d5df4e-8609-49f7-b8c9-8c2b445b9623 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:43.290897 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f4d5df4e-8609-49f7-b8c9-8c2b445b9623 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:43.290897 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f4d5df4e-8609-49f7-b8c9-8c2b445b9623 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1271 microversion: 2.1 time: 0.171300 Jan 05 15:03:43.290897 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 304/620] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:43 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:43.290897 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c55b2e29-591a-4cad-86ea-5c2ce64ac0fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:43.291398 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c55b2e29-591a-4cad-86ea-5c2ce64ac0fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:43.291398 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c55b2e29-591a-4cad-86ea-5c2ce64ac0fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:43.291398 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c55b2e29-591a-4cad-86ea-5c2ce64ac0fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:43.291398 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c55b2e29-591a-4cad-86ea-5c2ce64ac0fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:43.292274 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c55b2e29-591a-4cad-86ea-5c2ce64ac0fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:43.318746 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c55b2e29-591a-4cad-86ea-5c2ce64ac0fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:43.325748 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c55b2e29-591a-4cad-86ea-5c2ce64ac0fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1671 microversion: 2.1 time: 0.146944 Jan 05 15:03:43.326314 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 305/621] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:43 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1671 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:43.330768 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-0cfbbe44-422d-4c3b-9ce9-aaf7b596e78a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:43.331711 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0cfbbe44-422d-4c3b-9ce9-aaf7b596e78a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:43.337330 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0cfbbe44-422d-4c3b-9ce9-aaf7b596e78a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:43.337777 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0cfbbe44-422d-4c3b-9ce9-aaf7b596e78a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:43.339859 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0cfbbe44-422d-4c3b-9ce9-aaf7b596e78a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:43.339859 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0cfbbe44-422d-4c3b-9ce9-aaf7b596e78a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:43.368872 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-0cfbbe44-422d-4c3b-9ce9-aaf7b596e78a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041428 Jan 05 15:03:43.369495 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 306/622] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Jan 5 15:03:43 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:03:43.402898 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "POST /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/action" status: 202 len: 0 microversion: 2.1 time: 1.134279 Jan 05 15:03:43.403510 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 317/623] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:03:42 2022] POST /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/action => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:03:43.453796 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-454570a2-c972-4608-a56c-290409086e92 req-23d4cbc9-5c98-4ff8-a0ee-2acae8fa7b8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:03:43.453796 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:43.453796 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:03:43.454785 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-447a5a74-d2ec-4db1-8db9-d325fdb7bfef tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:43.454785 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-447a5a74-d2ec-4db1-8db9-d325fdb7bfef tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:43.454973 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-454570a2-c972-4608-a56c-290409086e92 req-23d4cbc9-5c98-4ff8-a0ee-2acae8fa7b8b service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:43.454973 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-454570a2-c972-4608-a56c-290409086e92 req-23d4cbc9-5c98-4ff8-a0ee-2acae8fa7b8b service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:43.455146 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-447a5a74-d2ec-4db1-8db9-d325fdb7bfef tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:43.455146 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-447a5a74-d2ec-4db1-8db9-d325fdb7bfef tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:43.455146 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-447a5a74-d2ec-4db1-8db9-d325fdb7bfef tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:43.455146 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-447a5a74-d2ec-4db1-8db9-d325fdb7bfef tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:43.455471 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-454570a2-c972-4608-a56c-290409086e92 req-23d4cbc9-5c98-4ff8-a0ee-2acae8fa7b8b service nova] Creating event network-changed:4bda96b8-bc6e-4586-8d4d-5a66846e4b96 for instance 22497ce1-6400-4f16-a962-dce627a97693 on hv-cinder-maste Jan 05 15:03:43.455471 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-454570a2-c972-4608-a56c-290409086e92 req-23d4cbc9-5c98-4ff8-a0ee-2acae8fa7b8b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039097 Jan 05 15:03:43.455471 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 318/624] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:03:43.580881 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-447a5a74-d2ec-4db1-8db9-d325fdb7bfef tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:43.588714 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-447a5a74-d2ec-4db1-8db9-d325fdb7bfef tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1760 microversion: 2.1 time: 0.179621 Jan 05 15:03:43.589300 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 307/625] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:43 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1760 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:44.194931 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a1b82d54-9075-4c62-8bcf-6e4af662c9ea tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:44.195638 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a1b82d54-9075-4c62-8bcf-6e4af662c9ea tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:44.202332 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1b82d54-9075-4c62-8bcf-6e4af662c9ea tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:44.205674 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1b82d54-9075-4c62-8bcf-6e4af662c9ea tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:44.205674 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1b82d54-9075-4c62-8bcf-6e4af662c9ea tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:44.205674 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1b82d54-9075-4c62-8bcf-6e4af662c9ea tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:44.333367 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a1b82d54-9075-4c62-8bcf-6e4af662c9ea tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:44.340744 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a1b82d54-9075-4c62-8bcf-6e4af662c9ea tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1271 microversion: 2.1 time: 0.150033 Jan 05 15:03:44.341342 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 319/626] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:44 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:44.341878 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c28013a7-3584-4a28-849f-94676f3fffd5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:44.342479 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c28013a7-3584-4a28-849f-94676f3fffd5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:44.348612 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c28013a7-3584-4a28-849f-94676f3fffd5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:44.349056 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c28013a7-3584-4a28-849f-94676f3fffd5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:44.349845 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c28013a7-3584-4a28-849f-94676f3fffd5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:44.350273 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c28013a7-3584-4a28-849f-94676f3fffd5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:44.380106 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-13e6407c-4245-4999-9208-e3c258f3a505 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:44.381143 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-13e6407c-4245-4999-9208-e3c258f3a505 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:44.386905 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13e6407c-4245-4999-9208-e3c258f3a505 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:44.387352 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13e6407c-4245-4999-9208-e3c258f3a505 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:44.388116 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13e6407c-4245-4999-9208-e3c258f3a505 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:44.388538 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13e6407c-4245-4999-9208-e3c258f3a505 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:44.417427 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-13e6407c-4245-4999-9208-e3c258f3a505 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040792 Jan 05 15:03:44.418124 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 320/627] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Jan 5 15:03:44 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:03:44.477546 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c28013a7-3584-4a28-849f-94676f3fffd5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:44.485583 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c28013a7-3584-4a28-849f-94676f3fffd5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1671 microversion: 2.1 time: 0.147357 Jan 05 15:03:44.486146 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 308/628] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:44 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1671 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:45.358772 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86d9a981-1045-45dd-863e-3833f1e5d716 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:45.360039 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-86d9a981-1045-45dd-863e-3833f1e5d716 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:45.367703 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86d9a981-1045-45dd-863e-3833f1e5d716 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:45.368688 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86d9a981-1045-45dd-863e-3833f1e5d716 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:45.369548 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86d9a981-1045-45dd-863e-3833f1e5d716 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:45.370428 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86d9a981-1045-45dd-863e-3833f1e5d716 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:45.431530 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f5e52ae9-7ab4-4a1f-aa41-0be6f7684a28 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:45.432359 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f5e52ae9-7ab4-4a1f-aa41-0be6f7684a28 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:45.441367 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f5e52ae9-7ab4-4a1f-aa41-0be6f7684a28 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:45.442222 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f5e52ae9-7ab4-4a1f-aa41-0be6f7684a28 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:45.443217 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f5e52ae9-7ab4-4a1f-aa41-0be6f7684a28 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:45.443646 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f5e52ae9-7ab4-4a1f-aa41-0be6f7684a28 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:45.488558 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f5e52ae9-7ab4-4a1f-aa41-0be6f7684a28 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061933 Jan 05 15:03:45.490248 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 309/629] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Jan 5 15:03:45 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:03:45.503049 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-30a25516-79e9-4327-88f2-53580aeb3915 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:45.503903 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-30a25516-79e9-4327-88f2-53580aeb3915 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:45.510109 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-30a25516-79e9-4327-88f2-53580aeb3915 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:45.510799 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-30a25516-79e9-4327-88f2-53580aeb3915 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:45.511788 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-30a25516-79e9-4327-88f2-53580aeb3915 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:45.512378 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-30a25516-79e9-4327-88f2-53580aeb3915 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:45.697371 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-30a25516-79e9-4327-88f2-53580aeb3915 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:45.707958 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-30a25516-79e9-4327-88f2-53580aeb3915 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1671 microversion: 2.1 time: 0.207840 Jan 05 15:03:45.709516 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 310/630] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:45 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1671 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:45.739869 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-86d9a981-1045-45dd-863e-3833f1e5d716 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:45.747464 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-86d9a981-1045-45dd-863e-3833f1e5d716 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1271 microversion: 2.1 time: 0.393788 Jan 05 15:03:45.750088 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 321/631] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:45 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1271 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:46.354750 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-dd58804e-3942-420d-937f-f358b849d089 req-1eb2d114-5268-49ac-986c-965974de5d2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:03:46.356854 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:46.356854 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:03:46.364793 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-dd58804e-3942-420d-937f-f358b849d089 req-1eb2d114-5268-49ac-986c-965974de5d2e service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:46.365440 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-dd58804e-3942-420d-937f-f358b849d089 req-1eb2d114-5268-49ac-986c-965974de5d2e service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:46.385861 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-dd58804e-3942-420d-937f-f358b849d089 req-1eb2d114-5268-49ac-986c-965974de5d2e service nova] Creating event network-changed:b7c14da5-847f-4d0d-9e0e-5c9ad34c581c for instance 61994ccf-e8cd-41a1-aad1-c56ee0edd0af on hv-cinder-maste Jan 05 15:03:46.395787 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-dd58804e-3942-420d-937f-f358b849d089 req-1eb2d114-5268-49ac-986c-965974de5d2e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044888 Jan 05 15:03:46.397266 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 311/632] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:03:46.515240 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-643f97de-2137-45ef-8ee2-902878a9be39 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:46.515463 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-643f97de-2137-45ef-8ee2-902878a9be39 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:46.524837 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-643f97de-2137-45ef-8ee2-902878a9be39 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:46.525682 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-643f97de-2137-45ef-8ee2-902878a9be39 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:46.526821 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-643f97de-2137-45ef-8ee2-902878a9be39 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:46.528138 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-643f97de-2137-45ef-8ee2-902878a9be39 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:46.572963 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-643f97de-2137-45ef-8ee2-902878a9be39 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.072700 Jan 05 15:03:46.573745 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 322/633] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Jan 5 15:03:46 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:46.633904 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:46.634606 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:46.641529 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:46.641974 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:46.642747 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:46.643177 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:46.668855 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Going to try to terminate instance {{(pid=128789) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:03:46.727323 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d2ea3431-de34-4576-b892-baa4299f5b9e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:46.728498 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d2ea3431-de34-4576-b892-baa4299f5b9e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:46.736440 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2ea3431-de34-4576-b892-baa4299f5b9e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:46.736933 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2ea3431-de34-4576-b892-baa4299f5b9e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:46.737752 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2ea3431-de34-4576-b892-baa4299f5b9e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:46.738213 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2ea3431-de34-4576-b892-baa4299f5b9e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:47.024009 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 204 len: 0 microversion: 2.20 time: 0.394339 Jan 05 15:03:47.028108 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 312/634] 10.222.0.30 () {60 vars in 1279 bytes} [Wed Jan 5 15:03:46 2022] DELETE /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 05 15:03:47.030768 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e0b596bc-b801-4113-b8a1-3c8e74094990 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:47.031466 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e0b596bc-b801-4113-b8a1-3c8e74094990 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:47.037818 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e0b596bc-b801-4113-b8a1-3c8e74094990 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:47.038605 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e0b596bc-b801-4113-b8a1-3c8e74094990 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:47.039401 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e0b596bc-b801-4113-b8a1-3c8e74094990 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:47.039831 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e0b596bc-b801-4113-b8a1-3c8e74094990 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:47.046386 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d2ea3431-de34-4576-b892-baa4299f5b9e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:47.054199 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d2ea3431-de34-4576-b892-baa4299f5b9e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1671 microversion: 2.1 time: 0.331426 Jan 05 15:03:47.054859 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 323/635] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:46 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1671 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:47.059342 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2e5f9260-b072-4ea7-b01e-95403a185857 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:47.060032 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2e5f9260-b072-4ea7-b01e-95403a185857 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:47.066716 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e5f9260-b072-4ea7-b01e-95403a185857 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:47.067177 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e5f9260-b072-4ea7-b01e-95403a185857 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:47.068046 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e5f9260-b072-4ea7-b01e-95403a185857 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:47.068553 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e5f9260-b072-4ea7-b01e-95403a185857 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:47.197188 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e0b596bc-b801-4113-b8a1-3c8e74094990 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:47.209188 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e0b596bc-b801-4113-b8a1-3c8e74094990 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1271 microversion: 2.1 time: 0.182617 Jan 05 15:03:47.210046 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 313/636] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:47 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:47.272442 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e5f9260-b072-4ea7-b01e-95403a185857 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:47.280401 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e5f9260-b072-4ea7-b01e-95403a185857 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:47.282046 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e5f9260-b072-4ea7-b01e-95403a185857 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:47.283270 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2e5f9260-b072-4ea7-b01e-95403a185857 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.227274 Jan 05 15:03:47.283899 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 324/637] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:03:47 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:03:48.071587 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f1f18dcc-660f-4e5e-920f-571802a9562f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:48.072195 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f1f18dcc-660f-4e5e-920f-571802a9562f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:48.079198 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f1f18dcc-660f-4e5e-920f-571802a9562f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:48.079637 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f1f18dcc-660f-4e5e-920f-571802a9562f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:48.083231 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f1f18dcc-660f-4e5e-920f-571802a9562f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:48.083231 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f1f18dcc-660f-4e5e-920f-571802a9562f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:48.143867 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f1f18dcc-660f-4e5e-920f-571802a9562f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:48.152429 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f1f18dcc-660f-4e5e-920f-571802a9562f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1603 microversion: 2.1 time: 0.084528 Jan 05 15:03:48.153407 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 314/638] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:48 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1603 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:48.225731 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f1b8dc2-9ef9-40fa-b8b8-50043872b256 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:48.226265 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4f1b8dc2-9ef9-40fa-b8b8-50043872b256 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:48.232865 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f1b8dc2-9ef9-40fa-b8b8-50043872b256 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:48.233346 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f1b8dc2-9ef9-40fa-b8b8-50043872b256 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:48.234125 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f1b8dc2-9ef9-40fa-b8b8-50043872b256 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:48.234612 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f1b8dc2-9ef9-40fa-b8b8-50043872b256 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:48.303200 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-680da7d5-59a1-49f1-8434-d485f2eb319e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:48.304144 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-680da7d5-59a1-49f1-8434-d485f2eb319e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:48.310619 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-680da7d5-59a1-49f1-8434-d485f2eb319e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:48.312075 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-680da7d5-59a1-49f1-8434-d485f2eb319e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:48.313098 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-680da7d5-59a1-49f1-8434-d485f2eb319e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:48.314044 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-680da7d5-59a1-49f1-8434-d485f2eb319e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:48.377002 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4f1b8dc2-9ef9-40fa-b8b8-50043872b256 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:48.387406 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4f1b8dc2-9ef9-40fa-b8b8-50043872b256 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1271 microversion: 2.1 time: 0.165461 Jan 05 15:03:48.388639 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 325/639] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:48 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:48.418920 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-913f48da-c63b-4e5e-869d-e97a6e63a99c req-6af96b2e-6569-4242-a75d-444a99616f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3327c27f-a8e9-4b19-8041-fb5260278159", "name": "network-vif-deleted", "tag": "2886de19-8aa3-470c-a593-9381bdb36ca0"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:03:48.420626 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:48.420626 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:03:48.428864 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-913f48da-c63b-4e5e-869d-e97a6e63a99c req-6af96b2e-6569-4242-a75d-444a99616f3e service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:48.429439 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-913f48da-c63b-4e5e-869d-e97a6e63a99c req-6af96b2e-6569-4242-a75d-444a99616f3e service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:48.446330 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-913f48da-c63b-4e5e-869d-e97a6e63a99c req-6af96b2e-6569-4242-a75d-444a99616f3e service nova] Creating event network-vif-deleted:2886de19-8aa3-470c-a593-9381bdb36ca0 for instance 3327c27f-a8e9-4b19-8041-fb5260278159 on hv-cinder-maste Jan 05 15:03:48.452274 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-913f48da-c63b-4e5e-869d-e97a6e63a99c req-6af96b2e-6569-4242-a75d-444a99616f3e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036212 Jan 05 15:03:48.452900 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 326/640] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:03:48.461397 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-680da7d5-59a1-49f1-8434-d485f2eb319e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:48.469157 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-680da7d5-59a1-49f1-8434-d485f2eb319e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:48.470675 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-680da7d5-59a1-49f1-8434-d485f2eb319e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:48.471812 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-680da7d5-59a1-49f1-8434-d485f2eb319e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.172497 Jan 05 15:03:48.472357 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 315/641] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:03:48 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:03:49.170158 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f6acb3c1-da2d-494d-aadd-0b6ca74ba8b5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:49.171440 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f6acb3c1-da2d-494d-aadd-0b6ca74ba8b5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:49.177712 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6acb3c1-da2d-494d-aadd-0b6ca74ba8b5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:49.178168 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6acb3c1-da2d-494d-aadd-0b6ca74ba8b5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:49.178958 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6acb3c1-da2d-494d-aadd-0b6ca74ba8b5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:49.179390 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6acb3c1-da2d-494d-aadd-0b6ca74ba8b5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:49.244635 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-f6acb3c1-da2d-494d-aadd-0b6ca74ba8b5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:49.251965 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f6acb3c1-da2d-494d-aadd-0b6ca74ba8b5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1603 microversion: 2.1 time: 0.085856 Jan 05 15:03:49.252527 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 327/642] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:49 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1603 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:49.404447 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a4b464d0-1f96-4000-ae4c-0ff374995345 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:49.405199 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a4b464d0-1f96-4000-ae4c-0ff374995345 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:49.412792 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a4b464d0-1f96-4000-ae4c-0ff374995345 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:49.413349 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a4b464d0-1f96-4000-ae4c-0ff374995345 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:49.414132 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a4b464d0-1f96-4000-ae4c-0ff374995345 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:49.414566 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a4b464d0-1f96-4000-ae4c-0ff374995345 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:49.490686 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fca900a7-8ecf-4048-95c1-f09325638398 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:49.492119 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fca900a7-8ecf-4048-95c1-f09325638398 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:49.501460 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fca900a7-8ecf-4048-95c1-f09325638398 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:49.503523 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fca900a7-8ecf-4048-95c1-f09325638398 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:49.506863 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fca900a7-8ecf-4048-95c1-f09325638398 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:49.507798 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fca900a7-8ecf-4048-95c1-f09325638398 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:49.598348 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a4b464d0-1f96-4000-ae4c-0ff374995345 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:49.606727 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a4b464d0-1f96-4000-ae4c-0ff374995345 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1271 microversion: 2.1 time: 0.205861 Jan 05 15:03:49.607947 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 316/643] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:49 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1271 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:49.706756 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-fca900a7-8ecf-4048-95c1-f09325638398 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:49.716303 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-fca900a7-8ecf-4048-95c1-f09325638398 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:49.719595 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-fca900a7-8ecf-4048-95c1-f09325638398 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:49.720876 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fca900a7-8ecf-4048-95c1-f09325638398 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.234288 Jan 05 15:03:49.721608 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 328/644] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:03:49 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:03:50.268555 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7af04bc3-e424-435a-9e3b-444ed7ecc68e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:50.269059 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7af04bc3-e424-435a-9e3b-444ed7ecc68e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:50.275011 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7af04bc3-e424-435a-9e3b-444ed7ecc68e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:50.275457 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7af04bc3-e424-435a-9e3b-444ed7ecc68e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:50.276229 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7af04bc3-e424-435a-9e3b-444ed7ecc68e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:50.276721 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7af04bc3-e424-435a-9e3b-444ed7ecc68e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:50.358658 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7af04bc3-e424-435a-9e3b-444ed7ecc68e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:50.359232 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7af04bc3-e424-435a-9e3b-444ed7ecc68e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:50.360387 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-7af04bc3-e424-435a-9e3b-444ed7ecc68e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lazy-loading 'fault' on Instance uuid 3327c27f-a8e9-4b19-8041-fb5260278159 {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:03:50.407262 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-7af04bc3-e424-435a-9e3b-444ed7ecc68e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:50.416281 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7af04bc3-e424-435a-9e3b-444ed7ecc68e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 200 len: 1326 microversion: 2.1 time: 0.151411 Jan 05 15:03:50.416852 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 317/645] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:50 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 1326 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:50.623254 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7fa7b26f-90b7-4f1c-8514-705f2078b455 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:50.624506 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7fa7b26f-90b7-4f1c-8514-705f2078b455 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:50.632005 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa7b26f-90b7-4f1c-8514-705f2078b455 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:50.632875 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa7b26f-90b7-4f1c-8514-705f2078b455 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:50.634217 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa7b26f-90b7-4f1c-8514-705f2078b455 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:50.634905 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa7b26f-90b7-4f1c-8514-705f2078b455 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:50.741598 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-73e3ee06-9ec7-4bf0-9fd9-85b32106757c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:50.745295 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-73e3ee06-9ec7-4bf0-9fd9-85b32106757c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:50.761516 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-73e3ee06-9ec7-4bf0-9fd9-85b32106757c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:50.762346 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-73e3ee06-9ec7-4bf0-9fd9-85b32106757c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:50.762785 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-73e3ee06-9ec7-4bf0-9fd9-85b32106757c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:50.763223 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-73e3ee06-9ec7-4bf0-9fd9-85b32106757c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:50.858379 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-7fa7b26f-90b7-4f1c-8514-705f2078b455 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:50.868602 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7fa7b26f-90b7-4f1c-8514-705f2078b455 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1259 microversion: 2.1 time: 0.248949 Jan 05 15:03:50.881017 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 329/646] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:50 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1259 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:50.992071 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-73e3ee06-9ec7-4bf0-9fd9-85b32106757c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:51.000586 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-73e3ee06-9ec7-4bf0-9fd9-85b32106757c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:51.002120 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-73e3ee06-9ec7-4bf0-9fd9-85b32106757c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:51.003272 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-73e3ee06-9ec7-4bf0-9fd9-85b32106757c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.265905 Jan 05 15:03:51.005134 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 318/647] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:03:50 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:03:51.439208 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5d9dae1d-9731-45ee-8426-1a24b6442b45 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:51.439813 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5d9dae1d-9731-45ee-8426-1a24b6442b45 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:51.445810 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d9dae1d-9731-45ee-8426-1a24b6442b45 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:51.446253 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d9dae1d-9731-45ee-8426-1a24b6442b45 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:51.447019 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d9dae1d-9731-45ee-8426-1a24b6442b45 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:51.447447 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d9dae1d-9731-45ee-8426-1a24b6442b45 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:51.460770 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-5d9dae1d-9731-45ee-8426-1a24b6442b45 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] HTTP exception thrown: Instance 3327c27f-a8e9-4b19-8041-fb5260278159 could not be found. Jan 05 15:03:51.463542 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5d9dae1d-9731-45ee-8426-1a24b6442b45 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Returning 404 to user: Instance 3327c27f-a8e9-4b19-8041-fb5260278159 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:03:51.463542 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5d9dae1d-9731-45ee-8426-1a24b6442b45 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 404 len: 111 microversion: 2.1 time: 0.027220 Jan 05 15:03:51.463542 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 330/648] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:51 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:03:51.470762 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a52f7618-a271-4375-b9dc-3663f95a8ad6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '.version_select at 0x7f21724c4790>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:51.577243 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a52f7618-a271-4375-b9dc-3663f95a8ad6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-32348512" status: 202 len: 0 microversion: 2.1 time: 0.109914 Jan 05 15:03:51.577745 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 319/649] 10.222.0.30 () {58 vars in 1214 bytes} [Wed Jan 5 15:03:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-32348512 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:03:51.889102 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a6a6cd5c-21b3-4cd8-9743-45e82f4b2034 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:51.889971 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a6a6cd5c-21b3-4cd8-9743-45e82f4b2034 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:51.897945 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6a6cd5c-21b3-4cd8-9743-45e82f4b2034 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:51.898495 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6a6cd5c-21b3-4cd8-9743-45e82f4b2034 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:51.899368 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6a6cd5c-21b3-4cd8-9743-45e82f4b2034 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:51.899944 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6a6cd5c-21b3-4cd8-9743-45e82f4b2034 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:52.023656 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-fe7a825c-c000-4f68-8349-21044f25fc07 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:52.024572 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-fe7a825c-c000-4f68-8349-21044f25fc07 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:52.031926 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fe7a825c-c000-4f68-8349-21044f25fc07 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:52.032514 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fe7a825c-c000-4f68-8349-21044f25fc07 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:52.033461 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fe7a825c-c000-4f68-8349-21044f25fc07 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:52.034001 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fe7a825c-c000-4f68-8349-21044f25fc07 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:52.259193 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-fe7a825c-c000-4f68-8349-21044f25fc07 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:52.268377 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-fe7a825c-c000-4f68-8349-21044f25fc07 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:52.279574 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-fe7a825c-c000-4f68-8349-21044f25fc07 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:52.279574 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-fe7a825c-c000-4f68-8349-21044f25fc07 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1725 microversion: 2.20 time: 0.251691 Jan 05 15:03:52.279962 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a6a6cd5c-21b3-4cd8-9743-45e82f4b2034 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:52.280080 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 320/650] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:03:52 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:03:52.282427 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a6a6cd5c-21b3-4cd8-9743-45e82f4b2034 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1259 microversion: 2.1 time: 0.397023 Jan 05 15:03:52.283304 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 331/651] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:51 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1259 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:52.582070 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-58ad7e17-06e9-431a-b20c-df42ee8be554 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'create', calling method: .version_select at 0x7f21724da3a0>, body: {"keypair": {"name": "tempest-keypair-976524188"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:03:52.598220 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-58ad7e17-06e9-431a-b20c-df42ee8be554 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Getting quotas for project 715006ffd8ba4e5b963511ec759ae152. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:03:52.601999 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-58ad7e17-06e9-431a-b20c-df42ee8be554 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Getting quotas for user 2de1d8ec06134669a4db8ca248feceae and project 715006ffd8ba4e5b963511ec759ae152. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:03:52.902470 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-58ad7e17-06e9-431a-b20c-df42ee8be554 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Getting quotas for project 715006ffd8ba4e5b963511ec759ae152. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:03:52.906702 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-58ad7e17-06e9-431a-b20c-df42ee8be554 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Getting quotas for user 2de1d8ec06134669a4db8ca248feceae and project 715006ffd8ba4e5b963511ec759ae152. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:03:52.923004 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-58ad7e17-06e9-431a-b20c-df42ee8be554 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.344564 Jan 05 15:03:52.923605 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 321/652] 10.222.0.30 () {60 vars in 1157 bytes} [Wed Jan 5 15:03:52 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:53.010627 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-aed5b3ea-35bf-4e85-a10a-f83122c3df7b req-32fd9e08-46b8-452d-bf39-469100591ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "name": "network-vif-deleted", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:03:53.012876 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:53.012876 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:03:53.021045 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-aed5b3ea-35bf-4e85-a10a-f83122c3df7b req-32fd9e08-46b8-452d-bf39-469100591ffc service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:53.021601 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-aed5b3ea-35bf-4e85-a10a-f83122c3df7b req-32fd9e08-46b8-452d-bf39-469100591ffc service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:53.032812 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-aed5b3ea-35bf-4e85-a10a-f83122c3df7b req-32fd9e08-46b8-452d-bf39-469100591ffc service nova] Creating event network-vif-deleted:45483c3c-9f42-4aff-a962-22ff36647afc for instance 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 on hv-cinder-maste Jan 05 15:03:53.037740 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-aed5b3ea-35bf-4e85-a10a-f83122c3df7b req-32fd9e08-46b8-452d-bf39-469100591ffc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030836 Jan 05 15:03:53.038398 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 332/653] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:03:53.291791 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-34c8b7ad-e01e-4f29-b066-fa59cbb90b34 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:53.292403 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-34c8b7ad-e01e-4f29-b066-fa59cbb90b34 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:53.298558 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-34c8b7ad-e01e-4f29-b066-fa59cbb90b34 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:53.299010 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-34c8b7ad-e01e-4f29-b066-fa59cbb90b34 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:53.299708 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f38e39b2-aac9-48fa-8a29-4f6c1edf3d20 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:53.299867 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-34c8b7ad-e01e-4f29-b066-fa59cbb90b34 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:53.300288 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-34c8b7ad-e01e-4f29-b066-fa59cbb90b34 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:53.301027 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f38e39b2-aac9-48fa-8a29-4f6c1edf3d20 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:53.307334 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f38e39b2-aac9-48fa-8a29-4f6c1edf3d20 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:53.308001 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f38e39b2-aac9-48fa-8a29-4f6c1edf3d20 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:53.308781 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f38e39b2-aac9-48fa-8a29-4f6c1edf3d20 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:53.309242 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f38e39b2-aac9-48fa-8a29-4f6c1edf3d20 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:53.364448 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-34c8b7ad-e01e-4f29-b066-fa59cbb90b34 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:53.372947 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-34c8b7ad-e01e-4f29-b066-fa59cbb90b34 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:53.374513 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-34c8b7ad-e01e-4f29-b066-fa59cbb90b34 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:53.379258 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-34c8b7ad-e01e-4f29-b066-fa59cbb90b34 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1657 microversion: 2.20 time: 0.088316 Jan 05 15:03:53.380699 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 322/654] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:03:53 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1657 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:03:53.496031 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-f38e39b2-aac9-48fa-8a29-4f6c1edf3d20 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:53.504165 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f38e39b2-aac9-48fa-8a29-4f6c1edf3d20 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1259 microversion: 2.1 time: 0.208521 Jan 05 15:03:53.504978 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 333/655] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:53 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1259 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:54.398461 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-4b8b36ea-b67f-4720-b352-dcd0dd9c53f7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:54.399063 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-4b8b36ea-b67f-4720-b352-dcd0dd9c53f7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:54.405242 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4b8b36ea-b67f-4720-b352-dcd0dd9c53f7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:54.405695 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4b8b36ea-b67f-4720-b352-dcd0dd9c53f7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:54.406972 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4b8b36ea-b67f-4720-b352-dcd0dd9c53f7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:54.407409 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4b8b36ea-b67f-4720-b352-dcd0dd9c53f7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:54.438852 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4b8b36ea-b67f-4720-b352-dcd0dd9c53f7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:54.439303 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4b8b36ea-b67f-4720-b352-dcd0dd9c53f7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:54.439747 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-4b8b36ea-b67f-4720-b352-dcd0dd9c53f7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lazy-loading 'fault' on Instance uuid 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:03:54.482634 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-4b8b36ea-b67f-4720-b352-dcd0dd9c53f7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:54.493739 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-4b8b36ea-b67f-4720-b352-dcd0dd9c53f7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:54.493739 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-4b8b36ea-b67f-4720-b352-dcd0dd9c53f7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:54.493739 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-4b8b36ea-b67f-4720-b352-dcd0dd9c53f7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 200 len: 1371 microversion: 2.20 time: 0.098257 Jan 05 15:03:54.494032 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 323/656] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:03:54 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:03:54.523517 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-634f9e8f-7b63-4e0d-99de-bf3e6463123c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:54.524136 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-634f9e8f-7b63-4e0d-99de-bf3e6463123c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:54.532516 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-634f9e8f-7b63-4e0d-99de-bf3e6463123c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:54.532942 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-634f9e8f-7b63-4e0d-99de-bf3e6463123c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:54.533755 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-634f9e8f-7b63-4e0d-99de-bf3e6463123c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:54.534186 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-634f9e8f-7b63-4e0d-99de-bf3e6463123c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:54.672333 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-634f9e8f-7b63-4e0d-99de-bf3e6463123c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:54.679952 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-634f9e8f-7b63-4e0d-99de-bf3e6463123c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1259 microversion: 2.1 time: 0.162014 Jan 05 15:03:54.680528 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 334/657] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:54 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:55.513147 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-64b552d0-9402-45ce-aeba-aa980dab9fe8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:55.513611 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-64b552d0-9402-45ce-aeba-aa980dab9fe8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:55.520071 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-64b552d0-9402-45ce-aeba-aa980dab9fe8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:55.520527 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-64b552d0-9402-45ce-aeba-aa980dab9fe8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:55.521567 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-64b552d0-9402-45ce-aeba-aa980dab9fe8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:55.522178 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-64b552d0-9402-45ce-aeba-aa980dab9fe8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:55.536311 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-64b552d0-9402-45ce-aeba-aa980dab9fe8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] HTTP exception thrown: Instance 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 could not be found. Jan 05 15:03:55.538246 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-64b552d0-9402-45ce-aeba-aa980dab9fe8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Returning 404 to user: Instance 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:03:55.538246 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-64b552d0-9402-45ce-aeba-aa980dab9fe8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 404 len: 111 microversion: 2.20 time: 0.028485 Jan 05 15:03:55.538246 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 324/658] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:03:55 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 05 15:03:55.547713 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b11f19bc-386b-4442-9ba5-bf31dfb08232 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '.version_select at 0x7f2172b2bc10>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:55.662910 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b11f19bc-386b-4442-9ba5-bf31dfb08232 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-971799383" status: 204 len: 0 microversion: 2.20 time: 0.119419 Jan 05 15:03:55.666831 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 335/659] 10.222.0.30 () {60 vars in 1258 bytes} [Wed Jan 5 15:03:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-971799383 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 05 15:03:55.695662 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3eca551e-628b-40eb-ac8b-58bc7a87b48f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:55.696416 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3eca551e-628b-40eb-ac8b-58bc7a87b48f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:55.703170 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3eca551e-628b-40eb-ac8b-58bc7a87b48f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:55.703802 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3eca551e-628b-40eb-ac8b-58bc7a87b48f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:55.704979 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3eca551e-628b-40eb-ac8b-58bc7a87b48f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:55.705463 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3eca551e-628b-40eb-ac8b-58bc7a87b48f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:55.966140 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3eca551e-628b-40eb-ac8b-58bc7a87b48f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:55.974034 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3eca551e-628b-40eb-ac8b-58bc7a87b48f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1259 microversion: 2.1 time: 0.282161 Jan 05 15:03:55.984025 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 325/660] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:55 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1259 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:56.161596 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9ed08650-ae76-4189-8cf3-e608c4d27d4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-808492166", "imageRef": "e4c11159-1e41-437a-af97-eb5f10704ae6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb7bcda7-5039-4d82-bf68-12c9acc8a744"}], "security_groups": [{"name": "tempest-securitygroup--68262674"}], "key_name": "tempest-keypair-976524188", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:03:56.316556 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-9ed08650-ae76-4189-8cf3-e608c4d27d4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] validate_networks() for [('fb7bcda7-5039-4d82-bf68-12c9acc8a744', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 15:03:56.857307 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6f0775b5-ffc4-40f5-be5d-824a639ed8eb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'create', calling method: .version_select at 0x7f21724d08b0>, body: {"keypair": {"name": "tempest-keypair-1625399607"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:03:56.872680 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-6f0775b5-ffc4-40f5-be5d-824a639ed8eb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Getting quotas for project f4a45a70c5d046238abaad07fbe529e9. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:03:56.878271 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-6f0775b5-ffc4-40f5-be5d-824a639ed8eb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Getting quotas for user d43400b4646449ce94967ec5bab4eca1 and project f4a45a70c5d046238abaad07fbe529e9. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:03:56.882816 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9ed08650-ae76-4189-8cf3-e608c4d27d4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 15:03:56.883469 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9ed08650-ae76-4189-8cf3-e608c4d27d4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 15:03:56.884172 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9ed08650-ae76-4189-8cf3-e608c4d27d4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 15:03:56.884781 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9ed08650-ae76-4189-8cf3-e608c4d27d4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 15:03:56.885296 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9ed08650-ae76-4189-8cf3-e608c4d27d4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 15:03:56.894649 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ed08650-ae76-4189-8cf3-e608c4d27d4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:56.895328 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ed08650-ae76-4189-8cf3-e608c4d27d4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:56.896402 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ed08650-ae76-4189-8cf3-e608c4d27d4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:56.896907 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ed08650-ae76-4189-8cf3-e608c4d27d4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:56.915488 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-9ed08650-ae76-4189-8cf3-e608c4d27d4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Getting quotas for project 715006ffd8ba4e5b963511ec759ae152. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:03:56.919792 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-9ed08650-ae76-4189-8cf3-e608c4d27d4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Getting quotas for user 2de1d8ec06134669a4db8ca248feceae and project 715006ffd8ba4e5b963511ec759ae152. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:03:56.930791 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9ed08650-ae76-4189-8cf3-e608c4d27d4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 15:03:56.933231 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9ed08650-ae76-4189-8cf3-e608c4d27d4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4c11159-1e41-437a-af97-eb5f10704ae6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 15:03:57.112198 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9ed08650-ae76-4189-8cf3-e608c4d27d4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.957144 Jan 05 15:03:57.114868 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 336/661] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 15:03:56 2022] POST /compute/v2.1/servers => generated 400 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 15:03:57.117964 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a0b0387-b53b-4bce-9eb0-96ecdcf1b7af tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:57.118542 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2a0b0387-b53b-4bce-9eb0-96ecdcf1b7af tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:57.125884 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a0b0387-b53b-4bce-9eb0-96ecdcf1b7af tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:57.126333 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a0b0387-b53b-4bce-9eb0-96ecdcf1b7af tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:57.127197 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a0b0387-b53b-4bce-9eb0-96ecdcf1b7af tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:57.127643 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a0b0387-b53b-4bce-9eb0-96ecdcf1b7af tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:57.142949 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-6f0775b5-ffc4-40f5-be5d-824a639ed8eb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Getting quotas for project f4a45a70c5d046238abaad07fbe529e9. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:03:57.149250 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-6f0775b5-ffc4-40f5-be5d-824a639ed8eb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Getting quotas for user d43400b4646449ce94967ec5bab4eca1 and project f4a45a70c5d046238abaad07fbe529e9. Resources: {'key_pairs'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:03:57.196352 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6f0775b5-ffc4-40f5-be5d-824a639ed8eb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.345826 Jan 05 15:03:57.196821 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 326/662] 10.222.0.30 () {62 vars in 1198 bytes} [Wed Jan 5 15:03:56 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 347 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 05 15:03:57.210595 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b3825864-8d0c-4f67-bc4d-c0051d55bbc3 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:57.212522 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b3825864-8d0c-4f67-bc4d-c0051d55bbc3 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:57.289919 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b3825864-8d0c-4f67-bc4d-c0051d55bbc3 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:57.298825 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b3825864-8d0c-4f67-bc4d-c0051d55bbc3 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1236 microversion: 2.1 time: 0.099670 Jan 05 15:03:57.300651 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 327/663] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:57 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1236 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:57.310497 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-2a0b0387-b53b-4bce-9eb0-96ecdcf1b7af tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:57.318515 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2a0b0387-b53b-4bce-9eb0-96ecdcf1b7af tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1259 microversion: 2.1 time: 0.204030 Jan 05 15:03:57.319265 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 337/664] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:57 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1259 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:58.322945 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-0a52c34a-2979-45bb-b4ea-541377fed690 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:58.323543 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0a52c34a-2979-45bb-b4ea-541377fed690 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:58.330433 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0a52c34a-2979-45bb-b4ea-541377fed690 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:58.334524 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0a52c34a-2979-45bb-b4ea-541377fed690 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:58.334524 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0a52c34a-2979-45bb-b4ea-541377fed690 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:58.334524 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0a52c34a-2979-45bb-b4ea-541377fed690 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:58.335115 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9bad97ae-6e03-4945-b1cd-93d05d565696 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:58.335524 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9bad97ae-6e03-4945-b1cd-93d05d565696 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:58.341745 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bad97ae-6e03-4945-b1cd-93d05d565696 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:58.342190 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bad97ae-6e03-4945-b1cd-93d05d565696 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:58.342970 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bad97ae-6e03-4945-b1cd-93d05d565696 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:58.343558 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bad97ae-6e03-4945-b1cd-93d05d565696 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:58.399346 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-0a52c34a-2979-45bb-b4ea-541377fed690 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:58.406786 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-0a52c34a-2979-45bb-b4ea-541377fed690 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1240 microversion: 2.1 time: 0.087828 Jan 05 15:03:58.416094 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 328/665] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:58 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:58.497840 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-9bad97ae-6e03-4945-b1cd-93d05d565696 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:58.506676 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9bad97ae-6e03-4945-b1cd-93d05d565696 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1259 microversion: 2.1 time: 0.175781 Jan 05 15:03:58.507239 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 338/666] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:58 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:59.424180 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-43299269-99fe-4d09-9326-18ea86814f0f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:59.424846 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-43299269-99fe-4d09-9326-18ea86814f0f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:59.431758 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-43299269-99fe-4d09-9326-18ea86814f0f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:59.432687 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-43299269-99fe-4d09-9326-18ea86814f0f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:59.433744 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-43299269-99fe-4d09-9326-18ea86814f0f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:59.434592 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-43299269-99fe-4d09-9326-18ea86814f0f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:59.523117 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-368137c0-c522-438d-9d86-20f56127c334 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:03:59.524270 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-368137c0-c522-438d-9d86-20f56127c334 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:03:59.531769 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-368137c0-c522-438d-9d86-20f56127c334 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:59.532444 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-368137c0-c522-438d-9d86-20f56127c334 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:59.533427 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-368137c0-c522-438d-9d86-20f56127c334 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:03:59.534475 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-368137c0-c522-438d-9d86-20f56127c334 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:03:59.552039 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-43299269-99fe-4d09-9326-18ea86814f0f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:59.561611 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-43299269-99fe-4d09-9326-18ea86814f0f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1296 microversion: 2.1 time: 0.141702 Jan 05 15:03:59.562249 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 329/667] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:59 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1296 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:03:59.798242 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-368137c0-c522-438d-9d86-20f56127c334 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:03:59.805971 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-368137c0-c522-438d-9d86-20f56127c334 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1259 microversion: 2.1 time: 0.286336 Jan 05 15:03:59.806606 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 339/668] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:03:59 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1259 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:03:59.968772 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-992971549", "imageRef": "e4c11159-1e41-437a-af97-eb5f10704ae6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c375b41-1339-4d14-93e7-e473aa7e6978"}], "security_groups": [{"name": "tempest-securitygroup--1433805968"}], "key_name": "tempest-keypair-1625399607", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:00.090629 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.network.neutron [None req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] validate_networks() for [('1c375b41-1339-4d14-93e7-e473aa7e6978', None, None, None, None, None)] {{(pid=128789) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 15:04:00.578755 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0ea09a4c-7ece-4433-b7dc-c7ceab813bf4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:00.579358 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0ea09a4c-7ece-4433-b7dc-c7ceab813bf4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:00.586263 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ea09a4c-7ece-4433-b7dc-c7ceab813bf4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:00.586995 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ea09a4c-7ece-4433-b7dc-c7ceab813bf4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:00.587796 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ea09a4c-7ece-4433-b7dc-c7ceab813bf4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:00.588227 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ea09a4c-7ece-4433-b7dc-c7ceab813bf4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:00.740214 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Flavor limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 15:04:00.741336 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Image limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 15:04:00.743713 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Flavor pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 15:04:00.744460 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Image pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 15:04:00.746280 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 15:04:00.760642 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-0ea09a4c-7ece-4433-b7dc-c7ceab813bf4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:00.762225 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:00.762677 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:00.763480 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:00.764125 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:00.777561 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0ea09a4c-7ece-4433-b7dc-c7ceab813bf4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1360 microversion: 2.1 time: 0.197143 Jan 05 15:04:00.777561 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 340/669] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:00 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1360 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:04:00.788678 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Getting quotas for project f4a45a70c5d046238abaad07fbe529e9. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:04:00.793183 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Getting quotas for user d43400b4646449ce94967ec5bab4eca1 and project f4a45a70c5d046238abaad07fbe529e9. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:04:00.810679 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Going to run 1 instances... {{(pid=128789) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 15:04:00.814696 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4c11159-1e41-437a-af97-eb5f10704ae6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 15:04:00.823395 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd0eaee6-f7e5-4054-920b-d4ca6b4e1ac4 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:00.824009 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bd0eaee6-f7e5-4054-920b-d4ca6b4e1ac4 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:00.831913 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd0eaee6-f7e5-4054-920b-d4ca6b4e1ac4 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:00.833695 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd0eaee6-f7e5-4054-920b-d4ca6b4e1ac4 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:00.840864 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd0eaee6-f7e5-4054-920b-d4ca6b4e1ac4 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:00.841612 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd0eaee6-f7e5-4054-920b-d4ca6b4e1ac4 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:00.980847 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.019036 Jan 05 15:04:00.982117 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 330/670] 10.222.0.30 () {62 vars in 1187 bytes} [Wed Jan 5 15:03:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 05 15:04:00.992245 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-99b51ef8-2f2b-4aa7-bb2f-10c0960af540 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:00.993216 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-99b51ef8-2f2b-4aa7-bb2f-10c0960af540 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:01.046380 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-99b51ef8-2f2b-4aa7-bb2f-10c0960af540 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:01.054313 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-99b51ef8-2f2b-4aa7-bb2f-10c0960af540 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:01.055717 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-99b51ef8-2f2b-4aa7-bb2f-10c0960af540 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:01.056822 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-99b51ef8-2f2b-4aa7-bb2f-10c0960af540 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1281 microversion: 2.20 time: 0.068161 Jan 05 15:04:01.057531 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 331/671] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:04:00 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:04:01.123944 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-bd0eaee6-f7e5-4054-920b-d4ca6b4e1ac4 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:01.133377 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bd0eaee6-f7e5-4054-920b-d4ca6b4e1ac4 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1259 microversion: 2.1 time: 0.313587 Jan 05 15:04:01.134151 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 341/672] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:00 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1259 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:04:01.653988 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-533ec0bf-9090-4435-9541-ab28b5b4c755 req-2fcec89d-028a-4982-ae52-e5fc772d1bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62d39a5b-dac1-4667-b829-53506cf0c62b", "tag": "370464b7-853e-4daf-92d9-8ffcbe014202"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:01.657224 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:01.657224 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:04:01.674607 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-533ec0bf-9090-4435-9541-ab28b5b4c755 req-2fcec89d-028a-4982-ae52-e5fc772d1bfa service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:01.675249 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-533ec0bf-9090-4435-9541-ab28b5b4c755 req-2fcec89d-028a-4982-ae52-e5fc772d1bfa service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:01.695107 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-533ec0bf-9090-4435-9541-ab28b5b4c755 req-2fcec89d-028a-4982-ae52-e5fc772d1bfa service nova] Creating event network-changed:370464b7-853e-4daf-92d9-8ffcbe014202 for instance 62d39a5b-dac1-4667-b829-53506cf0c62b on hv-cinder-maste Jan 05 15:04:01.701426 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-533ec0bf-9090-4435-9541-ab28b5b4c755 req-2fcec89d-028a-4982-ae52-e5fc772d1bfa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054636 Jan 05 15:04:01.703019 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 332/673] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:04:01.777313 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-0bb0219b-ec7a-462b-8530-24cd6c727921 req-e206ac1a-dc1f-4c09-9f21-e194958ab2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "name": "network-vif-plugged", "status": "completed", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:01.779664 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:01.779664 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:04:01.789701 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-24b173aa-2a99-444c-ab7a-fe936c62357a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:01.791190 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-24b173aa-2a99-444c-ab7a-fe936c62357a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:01.799253 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-24b173aa-2a99-444c-ab7a-fe936c62357a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:01.802082 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-24b173aa-2a99-444c-ab7a-fe936c62357a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:01.802670 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0bb0219b-ec7a-462b-8530-24cd6c727921 req-e206ac1a-dc1f-4c09-9f21-e194958ab2d8 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:01.803264 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0bb0219b-ec7a-462b-8530-24cd6c727921 req-e206ac1a-dc1f-4c09-9f21-e194958ab2d8 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:01.807916 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-24b173aa-2a99-444c-ab7a-fe936c62357a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:01.811162 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-24b173aa-2a99-444c-ab7a-fe936c62357a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:01.832370 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-0bb0219b-ec7a-462b-8530-24cd6c727921 req-e206ac1a-dc1f-4c09-9f21-e194958ab2d8 service nova] Creating event network-vif-plugged:b7c14da5-847f-4d0d-9e0e-5c9ad34c581c for instance 61994ccf-e8cd-41a1-aad1-c56ee0edd0af on hv-cinder-maste Jan 05 15:04:01.838861 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-0bb0219b-ec7a-462b-8530-24cd6c727921 req-e206ac1a-dc1f-4c09-9f21-e194958ab2d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065407 Jan 05 15:04:01.839737 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 342/674] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:04:02.008800 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-24b173aa-2a99-444c-ab7a-fe936c62357a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:02.016831 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-24b173aa-2a99-444c-ab7a-fe936c62357a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1360 microversion: 2.1 time: 0.231641 Jan 05 15:04:02.017367 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 333/675] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:01 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1360 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:04:02.076022 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9bb68460-f204-4de7-9b22-f3e83e8c167d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:02.076709 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9bb68460-f204-4de7-9b22-f3e83e8c167d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:02.083216 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bb68460-f204-4de7-9b22-f3e83e8c167d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:02.083679 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bb68460-f204-4de7-9b22-f3e83e8c167d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:02.084465 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bb68460-f204-4de7-9b22-f3e83e8c167d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:02.084891 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bb68460-f204-4de7-9b22-f3e83e8c167d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:02.150373 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-cba011ae-b9da-460d-874d-150d42f63ee1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:02.150978 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-cba011ae-b9da-460d-874d-150d42f63ee1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:02.155477 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-9bb68460-f204-4de7-9b22-f3e83e8c167d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:02.157370 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cba011ae-b9da-460d-874d-150d42f63ee1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:02.157834 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cba011ae-b9da-460d-874d-150d42f63ee1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:02.159173 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cba011ae-b9da-460d-874d-150d42f63ee1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:02.167444 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cba011ae-b9da-460d-874d-150d42f63ee1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:02.167536 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-9bb68460-f204-4de7-9b22-f3e83e8c167d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:02.167536 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-9bb68460-f204-4de7-9b22-f3e83e8c167d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:02.167536 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9bb68460-f204-4de7-9b22-f3e83e8c167d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1285 microversion: 2.20 time: 0.095227 Jan 05 15:04:02.167867 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 343/676] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:04:02 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:04:02.346874 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-cba011ae-b9da-460d-874d-150d42f63ee1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:02.354516 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-cba011ae-b9da-460d-874d-150d42f63ee1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1259 microversion: 2.1 time: 0.208171 Jan 05 15:04:02.355086 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 334/677] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:02 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1259 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:04:03.032726 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-85a1abbc-9422-46b3-99b3-c10b5ff5a95a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:03.033408 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-85a1abbc-9422-46b3-99b3-c10b5ff5a95a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:03.039988 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85a1abbc-9422-46b3-99b3-c10b5ff5a95a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:03.040440 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85a1abbc-9422-46b3-99b3-c10b5ff5a95a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:03.041268 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85a1abbc-9422-46b3-99b3-c10b5ff5a95a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:03.041702 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85a1abbc-9422-46b3-99b3-c10b5ff5a95a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:03.187393 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-fbabb0bc-c14a-4109-a12d-9cb995a21830 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:03.188162 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-fbabb0bc-c14a-4109-a12d-9cb995a21830 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:03.194832 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fbabb0bc-c14a-4109-a12d-9cb995a21830 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:03.195619 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fbabb0bc-c14a-4109-a12d-9cb995a21830 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:03.196521 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fbabb0bc-c14a-4109-a12d-9cb995a21830 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:03.197263 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fbabb0bc-c14a-4109-a12d-9cb995a21830 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:03.290754 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-85a1abbc-9422-46b3-99b3-c10b5ff5a95a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:03.291465 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-fbabb0bc-c14a-4109-a12d-9cb995a21830 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:03.299772 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-85a1abbc-9422-46b3-99b3-c10b5ff5a95a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1360 microversion: 2.1 time: 0.270618 Jan 05 15:04:03.300339 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 344/678] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:03 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1360 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:03.309323 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-fbabb0bc-c14a-4109-a12d-9cb995a21830 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:03.311135 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-fbabb0bc-c14a-4109-a12d-9cb995a21830 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:03.312400 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-fbabb0bc-c14a-4109-a12d-9cb995a21830 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1333 microversion: 2.20 time: 0.128814 Jan 05 15:04:03.313601 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 335/679] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:04:03 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1333 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:04:03.371492 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0435410b-2c0c-4919-a477-5e0f4dc779c1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:03.372198 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0435410b-2c0c-4919-a477-5e0f4dc779c1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:03.379078 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0435410b-2c0c-4919-a477-5e0f4dc779c1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:03.379613 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0435410b-2c0c-4919-a477-5e0f4dc779c1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:03.380473 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0435410b-2c0c-4919-a477-5e0f4dc779c1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:03.381043 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0435410b-2c0c-4919-a477-5e0f4dc779c1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:03.523861 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-0435410b-2c0c-4919-a477-5e0f4dc779c1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:03.543445 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0435410b-2c0c-4919-a477-5e0f4dc779c1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1259 microversion: 2.1 time: 0.175490 Jan 05 15:04:03.544146 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 345/680] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:03 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:04.317088 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-75a6fcf5-7b57-4593-9494-50fde3db8182 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:04.317800 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-75a6fcf5-7b57-4593-9494-50fde3db8182 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:04.324275 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-75a6fcf5-7b57-4593-9494-50fde3db8182 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:04.324832 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-75a6fcf5-7b57-4593-9494-50fde3db8182 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:04.325738 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-75a6fcf5-7b57-4593-9494-50fde3db8182 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:04.326237 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-75a6fcf5-7b57-4593-9494-50fde3db8182 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:04.332951 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5767f19e-1eb6-438f-96a1-e9aa4338d815 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:04.333792 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5767f19e-1eb6-438f-96a1-e9aa4338d815 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:04.340828 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5767f19e-1eb6-438f-96a1-e9aa4338d815 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:04.341289 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5767f19e-1eb6-438f-96a1-e9aa4338d815 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:04.342112 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5767f19e-1eb6-438f-96a1-e9aa4338d815 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:04.345279 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5767f19e-1eb6-438f-96a1-e9aa4338d815 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:04.490200 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-75a6fcf5-7b57-4593-9494-50fde3db8182 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:04.498014 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-75a6fcf5-7b57-4593-9494-50fde3db8182 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1360 microversion: 2.1 time: 0.184645 Jan 05 15:04:04.498892 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 336/681] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:04 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1360 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:04.560659 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f39cd517-2a81-40ce-98c0-cd012f2b3e6d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:04.561004 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f39cd517-2a81-40ce-98c0-cd012f2b3e6d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:04.573604 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f39cd517-2a81-40ce-98c0-cd012f2b3e6d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:04.574272 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f39cd517-2a81-40ce-98c0-cd012f2b3e6d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:04.575358 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f39cd517-2a81-40ce-98c0-cd012f2b3e6d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:04.575951 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f39cd517-2a81-40ce-98c0-cd012f2b3e6d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:04.623389 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-5767f19e-1eb6-438f-96a1-e9aa4338d815 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:04.643835 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-5767f19e-1eb6-438f-96a1-e9aa4338d815 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:04.645986 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-5767f19e-1eb6-438f-96a1-e9aa4338d815 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:04.647143 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5767f19e-1eb6-438f-96a1-e9aa4338d815 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1407 microversion: 2.20 time: 0.319881 Jan 05 15:04:04.648204 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 346/682] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:04:04 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:04:04.755113 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f39cd517-2a81-40ce-98c0-cd012f2b3e6d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:04.762837 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f39cd517-2a81-40ce-98c0-cd012f2b3e6d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1442 microversion: 2.1 time: 0.206980 Jan 05 15:04:04.763438 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 337/683] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:04 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1442 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:04:04.780333 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-43bf5c71-2db0-4b0a-941c-db6d37ec8117 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:04.785900 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-43bf5c71-2db0-4b0a-941c-db6d37ec8117 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:04.792865 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43bf5c71-2db0-4b0a-941c-db6d37ec8117 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:04.798026 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43bf5c71-2db0-4b0a-941c-db6d37ec8117 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:04.799678 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43bf5c71-2db0-4b0a-941c-db6d37ec8117 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:04.800271 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43bf5c71-2db0-4b0a-941c-db6d37ec8117 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:05.057302 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-43bf5c71-2db0-4b0a-941c-db6d37ec8117 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:05.067176 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-43bf5c71-2db0-4b0a-941c-db6d37ec8117 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1442 microversion: 2.1 time: 0.290625 Jan 05 15:04:05.067941 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 347/684] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:04 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1442 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:05.519070 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ba692ed2-5a43-4f3b-af81-8f5136d4a403 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:05.521330 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ba692ed2-5a43-4f3b-af81-8f5136d4a403 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:05.528353 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ba692ed2-5a43-4f3b-af81-8f5136d4a403 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:05.528999 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ba692ed2-5a43-4f3b-af81-8f5136d4a403 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:05.530111 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ba692ed2-5a43-4f3b-af81-8f5136d4a403 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:05.531421 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ba692ed2-5a43-4f3b-af81-8f5136d4a403 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:05.630540 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6b9c6ddb-979c-4a60-9194-854b93de194c req-621c34e2-9086-4b94-805b-3d72dee67fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:05.634449 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:05.634449 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:04:05.651293 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6b9c6ddb-979c-4a60-9194-854b93de194c req-621c34e2-9086-4b94-805b-3d72dee67fea service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:05.651984 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6b9c6ddb-979c-4a60-9194-854b93de194c req-621c34e2-9086-4b94-805b-3d72dee67fea service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:05.666748 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6b9c6ddb-979c-4a60-9194-854b93de194c req-621c34e2-9086-4b94-805b-3d72dee67fea service nova] Creating event network-changed:0d57813b-5531-41c7-8d8d-8b2fc393b843 for instance a591f495-ff59-4865-87ea-c48041ea097f on hv-cinder-maste Jan 05 15:04:05.672374 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6b9c6ddb-979c-4a60-9194-854b93de194c req-621c34e2-9086-4b94-805b-3d72dee67fea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052362 Jan 05 15:04:05.673808 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 348/685] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:04:05.680492 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-161eeba7-9e8a-4770-a25b-00573a759dcc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:05.681654 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-161eeba7-9e8a-4770-a25b-00573a759dcc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:05.689370 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-161eeba7-9e8a-4770-a25b-00573a759dcc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:05.690286 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-161eeba7-9e8a-4770-a25b-00573a759dcc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:05.691908 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-161eeba7-9e8a-4770-a25b-00573a759dcc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:05.692746 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-161eeba7-9e8a-4770-a25b-00573a759dcc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:05.814240 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ba692ed2-5a43-4f3b-af81-8f5136d4a403 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:05.822436 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ba692ed2-5a43-4f3b-af81-8f5136d4a403 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1360 microversion: 2.1 time: 0.307900 Jan 05 15:04:05.823589 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 338/686] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:05 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1360 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:05.926292 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-73a25c90-93f4-447b-9ee5-f236bb475a82 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:05.928005 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-73a25c90-93f4-447b-9ee5-f236bb475a82 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:05.934894 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-73a25c90-93f4-447b-9ee5-f236bb475a82 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:05.935347 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-73a25c90-93f4-447b-9ee5-f236bb475a82 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:05.936311 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-73a25c90-93f4-447b-9ee5-f236bb475a82 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:05.936748 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-73a25c90-93f4-447b-9ee5-f236bb475a82 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:06.088728 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-161eeba7-9e8a-4770-a25b-00573a759dcc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:06.098637 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-161eeba7-9e8a-4770-a25b-00573a759dcc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:06.100292 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-161eeba7-9e8a-4770-a25b-00573a759dcc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:06.101685 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-161eeba7-9e8a-4770-a25b-00573a759dcc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1407 microversion: 2.20 time: 0.426299 Jan 05 15:04:06.102547 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 349/687] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:04:05 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1407 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:04:06.170742 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-73a25c90-93f4-447b-9ee5-f236bb475a82 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "POST /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/action" status: 202 len: 0 microversion: 2.1 time: 0.248015 Jan 05 15:04:06.172153 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 339/688] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:05 2022] POST /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:06.180040 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-df44e316-0e39-4391-88d4-eaa5b9235dc8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:06.180737 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-df44e316-0e39-4391-88d4-eaa5b9235dc8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:06.186761 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df44e316-0e39-4391-88d4-eaa5b9235dc8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:06.187324 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df44e316-0e39-4391-88d4-eaa5b9235dc8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:06.188173 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df44e316-0e39-4391-88d4-eaa5b9235dc8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:06.188681 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df44e316-0e39-4391-88d4-eaa5b9235dc8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:06.585026 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-df44e316-0e39-4391-88d4-eaa5b9235dc8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:06.594129 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-df44e316-0e39-4391-88d4-eaa5b9235dc8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1752 microversion: 2.1 time: 0.417037 Jan 05 15:04:06.597110 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 350/689] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:06 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1752 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:06.840333 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6292f976-5e59-4ce1-81e3-a6a14dad5a4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:06.841022 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-6292f976-5e59-4ce1-81e3-a6a14dad5a4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:06.847962 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6292f976-5e59-4ce1-81e3-a6a14dad5a4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:06.848407 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6292f976-5e59-4ce1-81e3-a6a14dad5a4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:06.849207 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6292f976-5e59-4ce1-81e3-a6a14dad5a4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:06.849636 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6292f976-5e59-4ce1-81e3-a6a14dad5a4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:06.990861 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-6292f976-5e59-4ce1-81e3-a6a14dad5a4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:06.999046 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6292f976-5e59-4ce1-81e3-a6a14dad5a4f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1360 microversion: 2.1 time: 0.163313 Jan 05 15:04:07.006596 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 340/690] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:06 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:07.121352 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e24fb26f-252c-4672-90f1-c07893964871 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:07.121948 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e24fb26f-252c-4672-90f1-c07893964871 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:07.130261 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e24fb26f-252c-4672-90f1-c07893964871 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:07.130800 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e24fb26f-252c-4672-90f1-c07893964871 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:07.131594 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e24fb26f-252c-4672-90f1-c07893964871 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:07.132092 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e24fb26f-252c-4672-90f1-c07893964871 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:07.617136 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-8f0f2f20-adc6-4a72-bcb8-e5e51e7801ce tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:07.618824 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-8f0f2f20-adc6-4a72-bcb8-e5e51e7801ce tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:07.633415 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8f0f2f20-adc6-4a72-bcb8-e5e51e7801ce tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:07.634062 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8f0f2f20-adc6-4a72-bcb8-e5e51e7801ce tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:07.635566 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8f0f2f20-adc6-4a72-bcb8-e5e51e7801ce tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:07.636758 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8f0f2f20-adc6-4a72-bcb8-e5e51e7801ce tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:07.657956 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e24fb26f-252c-4672-90f1-c07893964871 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:07.669198 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e24fb26f-252c-4672-90f1-c07893964871 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:07.681518 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e24fb26f-252c-4672-90f1-c07893964871 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:07.682680 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e24fb26f-252c-4672-90f1-c07893964871 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1407 microversion: 2.20 time: 0.565273 Jan 05 15:04:07.683562 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 351/691] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:04:07 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1407 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:04:07.846011 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-8f0f2f20-adc6-4a72-bcb8-e5e51e7801ce tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:07.853697 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-8f0f2f20-adc6-4a72-bcb8-e5e51e7801ce tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1752 microversion: 2.1 time: 0.245753 Jan 05 15:04:07.854521 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 341/692] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:07 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1752 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:04:08.017339 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-83901938-a1d5-4803-826e-48d3f02051fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:08.018255 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-83901938-a1d5-4803-826e-48d3f02051fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:08.024214 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83901938-a1d5-4803-826e-48d3f02051fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:08.024746 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83901938-a1d5-4803-826e-48d3f02051fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:08.025711 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83901938-a1d5-4803-826e-48d3f02051fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:08.026217 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83901938-a1d5-4803-826e-48d3f02051fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:08.269398 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-83901938-a1d5-4803-826e-48d3f02051fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:08.278584 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-83901938-a1d5-4803-826e-48d3f02051fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1360 microversion: 2.1 time: 0.265937 Jan 05 15:04:08.279444 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 352/693] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:08 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1360 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:08.700978 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f63c06fd-c9b0-4741-bffb-469d0e1eeb05 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:08.701633 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f63c06fd-c9b0-4741-bffb-469d0e1eeb05 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:08.708169 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f63c06fd-c9b0-4741-bffb-469d0e1eeb05 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:08.708736 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f63c06fd-c9b0-4741-bffb-469d0e1eeb05 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:08.709582 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f63c06fd-c9b0-4741-bffb-469d0e1eeb05 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:08.710183 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f63c06fd-c9b0-4741-bffb-469d0e1eeb05 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:08.843803 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f63c06fd-c9b0-4741-bffb-469d0e1eeb05 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:08.851597 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f63c06fd-c9b0-4741-bffb-469d0e1eeb05 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:08.853138 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f63c06fd-c9b0-4741-bffb-469d0e1eeb05 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:08.854502 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f63c06fd-c9b0-4741-bffb-469d0e1eeb05 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1407 microversion: 2.20 time: 0.157298 Jan 05 15:04:08.855063 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 342/694] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:04:08 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:04:08.870850 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ab6cfde7-e1d2-483b-a0d4-dc9efabf0b2b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:08.871562 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ab6cfde7-e1d2-483b-a0d4-dc9efabf0b2b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:08.877874 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab6cfde7-e1d2-483b-a0d4-dc9efabf0b2b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:08.878323 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab6cfde7-e1d2-483b-a0d4-dc9efabf0b2b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:08.879106 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab6cfde7-e1d2-483b-a0d4-dc9efabf0b2b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:08.879540 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab6cfde7-e1d2-483b-a0d4-dc9efabf0b2b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:09.097934 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-da31a1b5-104a-4ab1-9839-f7fdcd1ef624 req-0c2f05a0-5152-4365-8ece-fe3e694ff530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:09.100012 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:09.100012 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:04:09.102680 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-ab6cfde7-e1d2-483b-a0d4-dc9efabf0b2b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:09.108812 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-da31a1b5-104a-4ab1-9839-f7fdcd1ef624 req-0c2f05a0-5152-4365-8ece-fe3e694ff530 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:09.110076 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-da31a1b5-104a-4ab1-9839-f7fdcd1ef624 req-0c2f05a0-5152-4365-8ece-fe3e694ff530 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:09.112435 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ab6cfde7-e1d2-483b-a0d4-dc9efabf0b2b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1757 microversion: 2.1 time: 0.245226 Jan 05 15:04:09.123349 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-da31a1b5-104a-4ab1-9839-f7fdcd1ef624 req-0c2f05a0-5152-4365-8ece-fe3e694ff530 service nova] Creating event network-changed:b7c14da5-847f-4d0d-9e0e-5c9ad34c581c for instance 61994ccf-e8cd-41a1-aad1-c56ee0edd0af on hv-cinder-maste Jan 05 15:04:09.128356 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 353/695] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:08 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1757 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:09.129213 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-da31a1b5-104a-4ab1-9839-f7fdcd1ef624 req-0c2f05a0-5152-4365-8ece-fe3e694ff530 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035455 Jan 05 15:04:09.130483 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 343/696] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:04:09.296474 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c4cf84a-1e1f-490b-ac51-4c6f9277aeba tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:09.297887 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1c4cf84a-1e1f-490b-ac51-4c6f9277aeba tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:09.305513 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4cf84a-1e1f-490b-ac51-4c6f9277aeba tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:09.306233 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4cf84a-1e1f-490b-ac51-4c6f9277aeba tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:09.307549 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4cf84a-1e1f-490b-ac51-4c6f9277aeba tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:09.308177 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4cf84a-1e1f-490b-ac51-4c6f9277aeba tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:09.553352 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1c4cf84a-1e1f-490b-ac51-4c6f9277aeba tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:09.561842 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c4cf84a-1e1f-490b-ac51-4c6f9277aeba tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1360 microversion: 2.1 time: 0.269079 Jan 05 15:04:09.562475 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 354/697] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:09 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1360 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:09.873572 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c3eda75a-888c-4091-bdfc-5dba9a8bb222 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:09.874400 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c3eda75a-888c-4091-bdfc-5dba9a8bb222 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:09.880940 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c3eda75a-888c-4091-bdfc-5dba9a8bb222 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:09.881505 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c3eda75a-888c-4091-bdfc-5dba9a8bb222 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:09.882343 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c3eda75a-888c-4091-bdfc-5dba9a8bb222 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:09.882861 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c3eda75a-888c-4091-bdfc-5dba9a8bb222 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:10.013882 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c3eda75a-888c-4091-bdfc-5dba9a8bb222 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:10.023415 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c3eda75a-888c-4091-bdfc-5dba9a8bb222 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:10.025673 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c3eda75a-888c-4091-bdfc-5dba9a8bb222 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:10.027031 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c3eda75a-888c-4091-bdfc-5dba9a8bb222 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1407 microversion: 2.20 time: 0.158077 Jan 05 15:04:10.028440 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 344/698] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:04:09 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:04:10.034852 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-be804c39-d192-434c-8055-9034d727d9ca req-ce75d781-f220-4d8e-a290-4c45a20b1ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d39a5b-dac1-4667-b829-53506cf0c62b", "name": "network-vif-plugged", "status": "completed", "tag": "370464b7-853e-4daf-92d9-8ffcbe014202"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:10.042183 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:10.042183 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:04:10.055432 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-be804c39-d192-434c-8055-9034d727d9ca req-ce75d781-f220-4d8e-a290-4c45a20b1ff9 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:10.055871 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-be804c39-d192-434c-8055-9034d727d9ca req-ce75d781-f220-4d8e-a290-4c45a20b1ff9 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:10.070750 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-be804c39-d192-434c-8055-9034d727d9ca req-ce75d781-f220-4d8e-a290-4c45a20b1ff9 service nova] Creating event network-vif-plugged:370464b7-853e-4daf-92d9-8ffcbe014202 for instance 62d39a5b-dac1-4667-b829-53506cf0c62b on hv-cinder-maste Jan 05 15:04:10.076439 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-be804c39-d192-434c-8055-9034d727d9ca req-ce75d781-f220-4d8e-a290-4c45a20b1ff9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054092 Jan 05 15:04:10.083038 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 355/699] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:04:10.136792 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-8174f83a-f3f6-4a89-b4dc-449c13b8af47 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:10.138295 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-8174f83a-f3f6-4a89-b4dc-449c13b8af47 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:10.145195 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8174f83a-f3f6-4a89-b4dc-449c13b8af47 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:10.145745 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8174f83a-f3f6-4a89-b4dc-449c13b8af47 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:10.146612 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8174f83a-f3f6-4a89-b4dc-449c13b8af47 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:10.147120 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8174f83a-f3f6-4a89-b4dc-449c13b8af47 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:10.326618 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-8174f83a-f3f6-4a89-b4dc-449c13b8af47 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:10.332217 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-8174f83a-f3f6-4a89-b4dc-449c13b8af47 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1757 microversion: 2.1 time: 0.199860 Jan 05 15:04:10.332888 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 345/700] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:10 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:10.579810 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0c489398-9df7-4392-84d3-20fa21502c51 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:10.580605 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0c489398-9df7-4392-84d3-20fa21502c51 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:10.587409 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c489398-9df7-4392-84d3-20fa21502c51 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:10.587850 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c489398-9df7-4392-84d3-20fa21502c51 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:10.588633 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c489398-9df7-4392-84d3-20fa21502c51 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:10.589096 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c489398-9df7-4392-84d3-20fa21502c51 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:10.847920 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-0c489398-9df7-4392-84d3-20fa21502c51 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:10.855504 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0c489398-9df7-4392-84d3-20fa21502c51 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1360 microversion: 2.1 time: 0.280489 Jan 05 15:04:10.856075 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 356/701] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:10 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1360 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:11.046831 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-90544d49-6d4a-41a5-8d9c-4a88888042ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:11.047381 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-90544d49-6d4a-41a5-8d9c-4a88888042ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:11.053570 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-90544d49-6d4a-41a5-8d9c-4a88888042ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:11.054012 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-90544d49-6d4a-41a5-8d9c-4a88888042ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:11.054780 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-90544d49-6d4a-41a5-8d9c-4a88888042ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:11.055205 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-90544d49-6d4a-41a5-8d9c-4a88888042ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:11.189979 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-90544d49-6d4a-41a5-8d9c-4a88888042ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:11.197763 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-90544d49-6d4a-41a5-8d9c-4a88888042ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:11.199275 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-90544d49-6d4a-41a5-8d9c-4a88888042ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:11.200480 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-90544d49-6d4a-41a5-8d9c-4a88888042ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1407 microversion: 2.20 time: 0.157999 Jan 05 15:04:11.201033 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 346/702] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:04:11 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:04:11.349452 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-60987826-8778-4b72-b563-828183f49620 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:11.350053 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-60987826-8778-4b72-b563-828183f49620 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:11.356541 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60987826-8778-4b72-b563-828183f49620 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:11.356986 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60987826-8778-4b72-b563-828183f49620 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:11.366764 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60987826-8778-4b72-b563-828183f49620 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:11.366764 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60987826-8778-4b72-b563-828183f49620 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:11.498829 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-60987826-8778-4b72-b563-828183f49620 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:11.507129 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-60987826-8778-4b72-b563-828183f49620 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1757 microversion: 2.1 time: 0.161387 Jan 05 15:04:11.507696 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 357/703] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:11 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:11.871684 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b44f1d26-fd88-43eb-9ce4-1cf7bcd8dca9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:11.872473 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b44f1d26-fd88-43eb-9ce4-1cf7bcd8dca9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:11.879712 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b44f1d26-fd88-43eb-9ce4-1cf7bcd8dca9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:11.880481 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b44f1d26-fd88-43eb-9ce4-1cf7bcd8dca9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:11.881558 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b44f1d26-fd88-43eb-9ce4-1cf7bcd8dca9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:11.882096 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b44f1d26-fd88-43eb-9ce4-1cf7bcd8dca9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:12.011297 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b44f1d26-fd88-43eb-9ce4-1cf7bcd8dca9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:12.019296 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b44f1d26-fd88-43eb-9ce4-1cf7bcd8dca9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1360 microversion: 2.1 time: 0.151409 Jan 05 15:04:12.019866 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 347/704] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:11 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:12.218154 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a9a73333-ccb2-465b-b4a0-cf227c759191 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:12.218775 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a9a73333-ccb2-465b-b4a0-cf227c759191 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:12.224947 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9a73333-ccb2-465b-b4a0-cf227c759191 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:12.225417 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9a73333-ccb2-465b-b4a0-cf227c759191 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:12.226199 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9a73333-ccb2-465b-b4a0-cf227c759191 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:12.226628 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9a73333-ccb2-465b-b4a0-cf227c759191 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:12.364534 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a9a73333-ccb2-465b-b4a0-cf227c759191 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:12.372562 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a9a73333-ccb2-465b-b4a0-cf227c759191 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:12.374091 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a9a73333-ccb2-465b-b4a0-cf227c759191 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:12.375686 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a9a73333-ccb2-465b-b4a0-cf227c759191 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1407 microversion: 2.20 time: 0.161236 Jan 05 15:04:12.376239 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 358/705] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:04:12 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:04:12.524007 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f0a3f82b-430d-4909-8cc6-ea3fcd3b6a49 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:12.524607 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f0a3f82b-430d-4909-8cc6-ea3fcd3b6a49 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:12.532802 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f0a3f82b-430d-4909-8cc6-ea3fcd3b6a49 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:12.533281 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f0a3f82b-430d-4909-8cc6-ea3fcd3b6a49 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:12.534055 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f0a3f82b-430d-4909-8cc6-ea3fcd3b6a49 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:12.534482 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f0a3f82b-430d-4909-8cc6-ea3fcd3b6a49 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:12.684268 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f0a3f82b-430d-4909-8cc6-ea3fcd3b6a49 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:12.692715 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f0a3f82b-430d-4909-8cc6-ea3fcd3b6a49 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1757 microversion: 2.1 time: 0.172509 Jan 05 15:04:12.693300 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 348/706] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:12 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:13.035802 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-01386ed3-bd97-45ce-bcf6-aec5eb32383e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:13.036402 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-01386ed3-bd97-45ce-bcf6-aec5eb32383e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:13.042332 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01386ed3-bd97-45ce-bcf6-aec5eb32383e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:13.042775 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01386ed3-bd97-45ce-bcf6-aec5eb32383e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:13.043542 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01386ed3-bd97-45ce-bcf6-aec5eb32383e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:13.043991 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01386ed3-bd97-45ce-bcf6-aec5eb32383e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:13.169965 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-01386ed3-bd97-45ce-bcf6-aec5eb32383e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:13.177752 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-01386ed3-bd97-45ce-bcf6-aec5eb32383e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1546 microversion: 2.1 time: 0.145528 Jan 05 15:04:13.178424 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 359/707] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:13 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1546 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:13.194422 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b45b76e4-87c3-4430-af94-c263001f22f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:13.194916 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b45b76e4-87c3-4430-af94-c263001f22f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:13.200848 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b45b76e4-87c3-4430-af94-c263001f22f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:13.201131 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b45b76e4-87c3-4430-af94-c263001f22f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:13.201909 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b45b76e4-87c3-4430-af94-c263001f22f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:13.202342 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b45b76e4-87c3-4430-af94-c263001f22f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:13.280337 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b45b76e4-87c3-4430-af94-c263001f22f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089644 Jan 05 15:04:13.281116 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 349/708] 10.222.0.30 () {58 vars in 1274 bytes} [Wed Jan 5 15:04:13 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:04:13.393087 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-78fe5fef-33f1-4101-b25d-40ab54fd7797 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:13.394353 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-78fe5fef-33f1-4101-b25d-40ab54fd7797 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:13.400238 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78fe5fef-33f1-4101-b25d-40ab54fd7797 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:13.400682 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78fe5fef-33f1-4101-b25d-40ab54fd7797 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:13.401486 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78fe5fef-33f1-4101-b25d-40ab54fd7797 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:13.401915 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78fe5fef-33f1-4101-b25d-40ab54fd7797 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:13.654834 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-78fe5fef-33f1-4101-b25d-40ab54fd7797 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:13.663293 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-78fe5fef-33f1-4101-b25d-40ab54fd7797 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:13.664930 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-78fe5fef-33f1-4101-b25d-40ab54fd7797 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:13.666069 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-78fe5fef-33f1-4101-b25d-40ab54fd7797 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1407 microversion: 2.20 time: 0.276923 Jan 05 15:04:13.666629 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 360/709] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:04:13 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:04:13.709333 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-202200d6-d50b-4cbf-92c1-34a360285e82 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:13.710047 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-202200d6-d50b-4cbf-92c1-34a360285e82 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:13.715901 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-202200d6-d50b-4cbf-92c1-34a360285e82 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:13.716355 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-202200d6-d50b-4cbf-92c1-34a360285e82 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:13.717218 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-202200d6-d50b-4cbf-92c1-34a360285e82 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:13.717655 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-202200d6-d50b-4cbf-92c1-34a360285e82 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:13.856284 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6d93db7a-ea8a-472f-bcbd-a84ae599a56c req-61366f4f-1a0f-4cfd-b5b8-caeda01f8c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "name": "network-vif-plugged", "status": "completed", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:13.858242 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:13.858242 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:04:13.865003 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-202200d6-d50b-4cbf-92c1-34a360285e82 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:13.865747 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6d93db7a-ea8a-472f-bcbd-a84ae599a56c req-61366f4f-1a0f-4cfd-b5b8-caeda01f8c44 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:13.866187 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6d93db7a-ea8a-472f-bcbd-a84ae599a56c req-61366f4f-1a0f-4cfd-b5b8-caeda01f8c44 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:13.873005 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-202200d6-d50b-4cbf-92c1-34a360285e82 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1757 microversion: 2.1 time: 0.167392 Jan 05 15:04:13.873607 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 350/710] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:13 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:13.877175 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6d93db7a-ea8a-472f-bcbd-a84ae599a56c req-61366f4f-1a0f-4cfd-b5b8-caeda01f8c44 service nova] Creating event network-vif-plugged:0d57813b-5531-41c7-8d8d-8b2fc393b843 for instance a591f495-ff59-4865-87ea-c48041ea097f on hv-cinder-maste Jan 05 15:04:13.884618 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6d93db7a-ea8a-472f-bcbd-a84ae599a56c req-61366f4f-1a0f-4cfd-b5b8-caeda01f8c44 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032182 Jan 05 15:04:13.885320 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 361/711] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:04:14.427459 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e8f2ea07-ee6f-43f4-b22e-2571cc9661e0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:14.428650 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e8f2ea07-ee6f-43f4-b22e-2571cc9661e0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:14.441618 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e8f2ea07-ee6f-43f4-b22e-2571cc9661e0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:14.442068 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e8f2ea07-ee6f-43f4-b22e-2571cc9661e0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:14.442883 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e8f2ea07-ee6f-43f4-b22e-2571cc9661e0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:14.443318 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e8f2ea07-ee6f-43f4-b22e-2571cc9661e0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:14.444510 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6a4a17bf-acdd-4aa1-978a-a36665e50487 req-01fdbdf2-3a25-45ba-89db-05629e7e51db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62d39a5b-dac1-4667-b829-53506cf0c62b", "tag": "370464b7-853e-4daf-92d9-8ffcbe014202"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:14.446038 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:14.446038 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:04:14.455243 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6a4a17bf-acdd-4aa1-978a-a36665e50487 req-01fdbdf2-3a25-45ba-89db-05629e7e51db service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:14.455874 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6a4a17bf-acdd-4aa1-978a-a36665e50487 req-01fdbdf2-3a25-45ba-89db-05629e7e51db service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:14.474060 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6a4a17bf-acdd-4aa1-978a-a36665e50487 req-01fdbdf2-3a25-45ba-89db-05629e7e51db service nova] Creating event network-changed:370464b7-853e-4daf-92d9-8ffcbe014202 for instance 62d39a5b-dac1-4667-b829-53506cf0c62b on hv-cinder-maste Jan 05 15:04:14.480553 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6a4a17bf-acdd-4aa1-978a-a36665e50487 req-01fdbdf2-3a25-45ba-89db-05629e7e51db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040324 Jan 05 15:04:14.481715 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 362/712] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:04:14.684095 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b455113d-f393-4153-8ede-245c50b46be7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:14.684702 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b455113d-f393-4153-8ede-245c50b46be7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:14.690806 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b455113d-f393-4153-8ede-245c50b46be7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:14.691252 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b455113d-f393-4153-8ede-245c50b46be7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:14.692033 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b455113d-f393-4153-8ede-245c50b46be7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:14.692463 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b455113d-f393-4153-8ede-245c50b46be7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:14.726098 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e8f2ea07-ee6f-43f4-b22e-2571cc9661e0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 14 microversion: 2.1 time: 0.302277 Jan 05 15:04:14.726960 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 351/713] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:14 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 14 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:04:14.892430 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b3938334-0bea-4727-9056-585bc3994e47 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:14.892682 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b3938334-0bea-4727-9056-585bc3994e47 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:14.900334 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b3938334-0bea-4727-9056-585bc3994e47 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:14.900901 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b3938334-0bea-4727-9056-585bc3994e47 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:14.901801 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b3938334-0bea-4727-9056-585bc3994e47 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:14.902309 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b3938334-0bea-4727-9056-585bc3994e47 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:14.957289 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b455113d-f393-4153-8ede-245c50b46be7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:14.970434 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b455113d-f393-4153-8ede-245c50b46be7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:14.972589 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b455113d-f393-4153-8ede-245c50b46be7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:14.973773 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b455113d-f393-4153-8ede-245c50b46be7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1407 microversion: 2.20 time: 0.293775 Jan 05 15:04:14.985250 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 363/714] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:04:14 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:04:15.065441 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b3938334-0bea-4727-9056-585bc3994e47 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:15.073939 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b3938334-0bea-4727-9056-585bc3994e47 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1757 microversion: 2.1 time: 0.186660 Jan 05 15:04:15.074795 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 352/715] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:14 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:15.738111 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e056e019-55c6-468d-b790-e5fca9095713 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:15.739026 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e056e019-55c6-468d-b790-e5fca9095713 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:15.745246 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e056e019-55c6-468d-b790-e5fca9095713 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:15.745705 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e056e019-55c6-468d-b790-e5fca9095713 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:15.746481 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e056e019-55c6-468d-b790-e5fca9095713 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:15.746916 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e056e019-55c6-468d-b790-e5fca9095713 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:15.831031 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e056e019-55c6-468d-b790-e5fca9095713 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 14 microversion: 2.1 time: 0.096926 Jan 05 15:04:15.831835 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 364/716] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:15 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:04:15.991599 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-52f3d135-d36a-4cac-9701-9fefa0502f55 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:15.992309 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-52f3d135-d36a-4cac-9701-9fefa0502f55 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:15.998663 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-52f3d135-d36a-4cac-9701-9fefa0502f55 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:15.999101 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-52f3d135-d36a-4cac-9701-9fefa0502f55 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:15.999911 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-52f3d135-d36a-4cac-9701-9fefa0502f55 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:16.000338 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-52f3d135-d36a-4cac-9701-9fefa0502f55 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:16.091301 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a23c8450-9ec6-4022-9dc5-7bc50484efc4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:16.092085 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a23c8450-9ec6-4022-9dc5-7bc50484efc4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:16.099295 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a23c8450-9ec6-4022-9dc5-7bc50484efc4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:16.099748 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a23c8450-9ec6-4022-9dc5-7bc50484efc4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:16.100528 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a23c8450-9ec6-4022-9dc5-7bc50484efc4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:16.100959 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a23c8450-9ec6-4022-9dc5-7bc50484efc4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:16.131557 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-52f3d135-d36a-4cac-9701-9fefa0502f55 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:16.139756 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-52f3d135-d36a-4cac-9701-9fefa0502f55 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:16.141464 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-52f3d135-d36a-4cac-9701-9fefa0502f55 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:16.142761 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-52f3d135-d36a-4cac-9701-9fefa0502f55 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1599 microversion: 2.20 time: 0.155019 Jan 05 15:04:16.143398 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 353/717] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:04:15 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:04:16.160843 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e2c963cb-47d2-4b6e-971c-778337c5f49f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:16.161395 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e2c963cb-47d2-4b6e-971c-778337c5f49f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:16.167442 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e2c963cb-47d2-4b6e-971c-778337c5f49f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:16.167895 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e2c963cb-47d2-4b6e-971c-778337c5f49f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:16.169838 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e2c963cb-47d2-4b6e-971c-778337c5f49f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:16.169838 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e2c963cb-47d2-4b6e-971c-778337c5f49f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:16.248618 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e2c963cb-47d2-4b6e-971c-778337c5f49f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091972 Jan 05 15:04:16.253050 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 354/718] 10.222.0.30 () {60 vars in 1315 bytes} [Wed Jan 5 15:04:16 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:04:16.253238 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a23c8450-9ec6-4022-9dc5-7bc50484efc4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:16.258127 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a23c8450-9ec6-4022-9dc5-7bc50484efc4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1757 microversion: 2.1 time: 0.170749 Jan 05 15:04:16.258697 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 365/719] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:16 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:04:16.842195 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ca416838-3328-400a-ab22-8955663cf2f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:16.843162 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ca416838-3328-400a-ab22-8955663cf2f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:16.848868 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ca416838-3328-400a-ab22-8955663cf2f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:16.849454 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ca416838-3328-400a-ab22-8955663cf2f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:16.850265 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ca416838-3328-400a-ab22-8955663cf2f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:16.850703 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ca416838-3328-400a-ab22-8955663cf2f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:16.938488 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ca416838-3328-400a-ab22-8955663cf2f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 14 microversion: 2.1 time: 0.100267 Jan 05 15:04:16.941935 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 355/720] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:16 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:04:17.280807 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-01a46d90-6f52-4972-80df-1e2470fb8441 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:17.283904 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7ce3ea79-bb5f-4053-a090-cd2d49c8754a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:17.284564 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-01a46d90-6f52-4972-80df-1e2470fb8441 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:17.285042 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7ce3ea79-bb5f-4053-a090-cd2d49c8754a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:17.290837 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01a46d90-6f52-4972-80df-1e2470fb8441 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:17.291353 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01a46d90-6f52-4972-80df-1e2470fb8441 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:17.292049 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7ce3ea79-bb5f-4053-a090-cd2d49c8754a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:17.292270 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01a46d90-6f52-4972-80df-1e2470fb8441 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:17.292633 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7ce3ea79-bb5f-4053-a090-cd2d49c8754a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:17.292830 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01a46d90-6f52-4972-80df-1e2470fb8441 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:17.293577 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7ce3ea79-bb5f-4053-a090-cd2d49c8754a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:17.294083 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7ce3ea79-bb5f-4053-a090-cd2d49c8754a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:17.394790 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7ce3ea79-bb5f-4053-a090-cd2d49c8754a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 14 microversion: 2.20 time: 0.118654 Jan 05 15:04:17.395706 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 356/721] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:17 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:17.406844 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-32201c29-107f-42f4-bc69-3c8b2d60ccaa req-3183abee-f923-429e-a96d-33568913566c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:17.408555 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:17.408555 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:04:17.417612 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-32201c29-107f-42f4-bc69-3c8b2d60ccaa req-3183abee-f923-429e-a96d-33568913566c service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:17.418439 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-32201c29-107f-42f4-bc69-3c8b2d60ccaa req-3183abee-f923-429e-a96d-33568913566c service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:17.434524 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-32201c29-107f-42f4-bc69-3c8b2d60ccaa req-3183abee-f923-429e-a96d-33568913566c service nova] Creating event network-changed:0d57813b-5531-41c7-8d8d-8b2fc393b843 for instance a591f495-ff59-4865-87ea-c48041ea097f on hv-cinder-maste Jan 05 15:04:17.441759 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-32201c29-107f-42f4-bc69-3c8b2d60ccaa req-3183abee-f923-429e-a96d-33568913566c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043632 Jan 05 15:04:17.442368 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 357/722] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:04:17.462353 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-01a46d90-6f52-4972-80df-1e2470fb8441 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:17.470857 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-01a46d90-6f52-4972-80df-1e2470fb8441 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1757 microversion: 2.1 time: 0.199620 Jan 05 15:04:17.471423 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 366/723] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:17 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:17.950365 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-577da036-6695-4455-b8c0-c936b778b204 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:17.951715 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-577da036-6695-4455-b8c0-c936b778b204 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:17.958875 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-577da036-6695-4455-b8c0-c936b778b204 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:17.959451 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-577da036-6695-4455-b8c0-c936b778b204 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:17.960382 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-577da036-6695-4455-b8c0-c936b778b204 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:17.960956 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-577da036-6695-4455-b8c0-c936b778b204 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:18.082513 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-577da036-6695-4455-b8c0-c936b778b204 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 14 microversion: 2.1 time: 0.136094 Jan 05 15:04:18.088369 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 358/724] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:17 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:04:18.406282 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d7e282db-a10e-4695-94f7-c49c50f5959e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:18.407245 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d7e282db-a10e-4695-94f7-c49c50f5959e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:18.413498 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7e282db-a10e-4695-94f7-c49c50f5959e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:18.413960 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7e282db-a10e-4695-94f7-c49c50f5959e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:18.414731 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7e282db-a10e-4695-94f7-c49c50f5959e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:18.415158 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7e282db-a10e-4695-94f7-c49c50f5959e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:18.488448 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c2f89af6-acf9-4973-9a14-bcefb4484c4b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:18.489286 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c2f89af6-acf9-4973-9a14-bcefb4484c4b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:18.499865 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c2f89af6-acf9-4973-9a14-bcefb4484c4b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:18.500337 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c2f89af6-acf9-4973-9a14-bcefb4484c4b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:18.501135 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c2f89af6-acf9-4973-9a14-bcefb4484c4b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:18.501571 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c2f89af6-acf9-4973-9a14-bcefb4484c4b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:18.521694 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d7e282db-a10e-4695-94f7-c49c50f5959e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 14 microversion: 2.20 time: 0.119418 Jan 05 15:04:18.524840 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 367/725] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:18 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:18.650937 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c2f89af6-acf9-4973-9a14-bcefb4484c4b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:18.659357 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c2f89af6-acf9-4973-9a14-bcefb4484c4b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1757 microversion: 2.1 time: 0.175165 Jan 05 15:04:18.659921 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 359/726] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:18 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:04:19.094128 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-74f370eb-e95a-49eb-b107-ae5876a2d56c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:19.095159 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-74f370eb-e95a-49eb-b107-ae5876a2d56c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:19.101922 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74f370eb-e95a-49eb-b107-ae5876a2d56c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:19.102362 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74f370eb-e95a-49eb-b107-ae5876a2d56c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:19.103135 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74f370eb-e95a-49eb-b107-ae5876a2d56c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:19.103558 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74f370eb-e95a-49eb-b107-ae5876a2d56c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:19.204583 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-74f370eb-e95a-49eb-b107-ae5876a2d56c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 14 microversion: 2.1 time: 0.114337 Jan 05 15:04:19.205310 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 368/727] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:19 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:04:19.531882 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-32528a69-b57f-4430-875d-e526df0523be tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:19.532830 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-32528a69-b57f-4430-875d-e526df0523be tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:19.539180 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-32528a69-b57f-4430-875d-e526df0523be tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:19.539663 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-32528a69-b57f-4430-875d-e526df0523be tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:19.540473 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-32528a69-b57f-4430-875d-e526df0523be tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:19.540895 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-32528a69-b57f-4430-875d-e526df0523be tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:19.628241 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-32528a69-b57f-4430-875d-e526df0523be tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 14 microversion: 2.20 time: 0.100095 Jan 05 15:04:19.631386 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 360/728] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:19 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:19.677302 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8dbaf418-518d-40c0-87de-f2592ba557a6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:19.678054 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8dbaf418-518d-40c0-87de-f2592ba557a6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:19.685016 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dbaf418-518d-40c0-87de-f2592ba557a6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:19.685450 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dbaf418-518d-40c0-87de-f2592ba557a6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:19.686225 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dbaf418-518d-40c0-87de-f2592ba557a6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:19.686663 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dbaf418-518d-40c0-87de-f2592ba557a6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:19.831517 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8dbaf418-518d-40c0-87de-f2592ba557a6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:19.839172 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8dbaf418-518d-40c0-87de-f2592ba557a6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1757 microversion: 2.1 time: 0.165954 Jan 05 15:04:19.839736 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 369/729] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:19 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:20.216112 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2ce5d3dd-76d2-4269-8d10-2927f5966043 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:20.217015 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2ce5d3dd-76d2-4269-8d10-2927f5966043 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:20.224433 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2ce5d3dd-76d2-4269-8d10-2927f5966043 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:20.227591 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2ce5d3dd-76d2-4269-8d10-2927f5966043 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:20.227591 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2ce5d3dd-76d2-4269-8d10-2927f5966043 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:20.227591 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2ce5d3dd-76d2-4269-8d10-2927f5966043 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:20.329574 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2ce5d3dd-76d2-4269-8d10-2927f5966043 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 14 microversion: 2.1 time: 0.117441 Jan 05 15:04:20.330229 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 361/730] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:20 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:04:20.639047 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-16ce1385-f8c5-44d8-aa64-d6fd7c25e10c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:20.640640 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-16ce1385-f8c5-44d8-aa64-d6fd7c25e10c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:20.646923 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16ce1385-f8c5-44d8-aa64-d6fd7c25e10c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:20.647371 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16ce1385-f8c5-44d8-aa64-d6fd7c25e10c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:20.648149 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16ce1385-f8c5-44d8-aa64-d6fd7c25e10c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:20.648575 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16ce1385-f8c5-44d8-aa64-d6fd7c25e10c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:20.738263 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-16ce1385-f8c5-44d8-aa64-d6fd7c25e10c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 14 microversion: 2.20 time: 0.102751 Jan 05 15:04:20.739097 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 370/731] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:20 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:20.856652 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e69e181a-a831-4a23-a3e9-42230b772af7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:20.857369 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e69e181a-a831-4a23-a3e9-42230b772af7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:20.864868 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e69e181a-a831-4a23-a3e9-42230b772af7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:20.865350 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e69e181a-a831-4a23-a3e9-42230b772af7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:20.866122 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e69e181a-a831-4a23-a3e9-42230b772af7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:20.866549 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e69e181a-a831-4a23-a3e9-42230b772af7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:21.011349 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e69e181a-a831-4a23-a3e9-42230b772af7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:21.019665 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e69e181a-a831-4a23-a3e9-42230b772af7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1757 microversion: 2.1 time: 0.167229 Jan 05 15:04:21.020199 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 362/732] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:20 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:21.340876 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5d5d3620-d1f9-4273-b465-cf2d94dc72e8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:21.341835 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5d5d3620-d1f9-4273-b465-cf2d94dc72e8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:21.349144 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d5d3620-d1f9-4273-b465-cf2d94dc72e8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:21.349591 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d5d3620-d1f9-4273-b465-cf2d94dc72e8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:21.350364 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d5d3620-d1f9-4273-b465-cf2d94dc72e8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:21.350793 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d5d3620-d1f9-4273-b465-cf2d94dc72e8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:21.449717 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5d5d3620-d1f9-4273-b465-cf2d94dc72e8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 14 microversion: 2.1 time: 0.112791 Jan 05 15:04:21.450364 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 371/733] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:21 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:04:21.748961 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-5f1569b7-78ff-4d80-aabc-d1a47c09813d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:21.750540 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-5f1569b7-78ff-4d80-aabc-d1a47c09813d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:21.756780 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5f1569b7-78ff-4d80-aabc-d1a47c09813d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:21.757173 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5f1569b7-78ff-4d80-aabc-d1a47c09813d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:21.757942 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5f1569b7-78ff-4d80-aabc-d1a47c09813d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:21.758401 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5f1569b7-78ff-4d80-aabc-d1a47c09813d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:21.847554 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-5f1569b7-78ff-4d80-aabc-d1a47c09813d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 14 microversion: 2.20 time: 0.102165 Jan 05 15:04:21.848173 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 363/734] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:21 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:22.037741 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-04b88c1d-d8af-433c-86dd-edad9252ee4f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:22.038580 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-04b88c1d-d8af-433c-86dd-edad9252ee4f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:22.045561 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04b88c1d-d8af-433c-86dd-edad9252ee4f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:22.046014 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04b88c1d-d8af-433c-86dd-edad9252ee4f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:22.047349 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04b88c1d-d8af-433c-86dd-edad9252ee4f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:22.047786 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04b88c1d-d8af-433c-86dd-edad9252ee4f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:22.342553 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-04b88c1d-d8af-433c-86dd-edad9252ee4f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:22.351635 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-04b88c1d-d8af-433c-86dd-edad9252ee4f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1757 microversion: 2.1 time: 0.317916 Jan 05 15:04:22.352209 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 372/735] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:22 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1757 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:22.461547 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2dd8a3a4-976e-4e18-95f7-7e292eb96867 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:22.462550 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2dd8a3a4-976e-4e18-95f7-7e292eb96867 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:22.469386 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2dd8a3a4-976e-4e18-95f7-7e292eb96867 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:22.469840 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2dd8a3a4-976e-4e18-95f7-7e292eb96867 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:22.470614 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2dd8a3a4-976e-4e18-95f7-7e292eb96867 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:22.471048 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2dd8a3a4-976e-4e18-95f7-7e292eb96867 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:22.565572 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2dd8a3a4-976e-4e18-95f7-7e292eb96867 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 14 microversion: 2.1 time: 0.107836 Jan 05 15:04:22.567344 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 364/736] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:22 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:04:22.859559 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1a0cf12a-41de-47eb-a1fe-d67651e6d934 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:22.860405 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1a0cf12a-41de-47eb-a1fe-d67651e6d934 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:22.867377 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a0cf12a-41de-47eb-a1fe-d67651e6d934 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:22.867821 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a0cf12a-41de-47eb-a1fe-d67651e6d934 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:22.868591 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a0cf12a-41de-47eb-a1fe-d67651e6d934 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:22.869022 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a0cf12a-41de-47eb-a1fe-d67651e6d934 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:22.948903 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1a0cf12a-41de-47eb-a1fe-d67651e6d934 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 14 microversion: 2.20 time: 0.093776 Jan 05 15:04:22.949552 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 373/737] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:22 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:04:23.370292 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b0bfb302-28b0-4bae-9ed5-dbec6ccac0a6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:23.370988 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b0bfb302-28b0-4bae-9ed5-dbec6ccac0a6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:23.378623 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b0bfb302-28b0-4bae-9ed5-dbec6ccac0a6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:23.379100 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b0bfb302-28b0-4bae-9ed5-dbec6ccac0a6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:23.379882 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b0bfb302-28b0-4bae-9ed5-dbec6ccac0a6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:23.380320 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b0bfb302-28b0-4bae-9ed5-dbec6ccac0a6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:23.571125 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b0bfb302-28b0-4bae-9ed5-dbec6ccac0a6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:23.580249 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b0bfb302-28b0-4bae-9ed5-dbec6ccac0a6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1757 microversion: 2.1 time: 0.213738 Jan 05 15:04:23.580616 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 365/738] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:23 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1757 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:23.581516 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8b7cf2e4-cfcc-4c4d-9097-545f6b18fedb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:23.582710 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8b7cf2e4-cfcc-4c4d-9097-545f6b18fedb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:23.589608 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b7cf2e4-cfcc-4c4d-9097-545f6b18fedb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:23.590009 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b7cf2e4-cfcc-4c4d-9097-545f6b18fedb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:23.590795 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b7cf2e4-cfcc-4c4d-9097-545f6b18fedb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:23.591262 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b7cf2e4-cfcc-4c4d-9097-545f6b18fedb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:23.687500 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8b7cf2e4-cfcc-4c4d-9097-545f6b18fedb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 14 microversion: 2.1 time: 0.110415 Jan 05 15:04:23.688313 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 374/739] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:23 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:04:23.959510 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f7b8c17b-c071-4835-9894-63a80bb1105d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:23.960402 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f7b8c17b-c071-4835-9894-63a80bb1105d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:23.966545 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f7b8c17b-c071-4835-9894-63a80bb1105d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:23.966994 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f7b8c17b-c071-4835-9894-63a80bb1105d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:23.967769 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f7b8c17b-c071-4835-9894-63a80bb1105d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:23.968201 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f7b8c17b-c071-4835-9894-63a80bb1105d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:24.090455 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f7b8c17b-c071-4835-9894-63a80bb1105d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 14 microversion: 2.20 time: 0.134268 Jan 05 15:04:24.090999 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 366/740] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:23 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:24.597316 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a5162651-a5ac-4ea3-ae1d-cd321242ba1c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:04:24.597919 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a5162651-a5ac-4ea3-ae1d-cd321242ba1c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:24.607973 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5162651-a5ac-4ea3-ae1d-cd321242ba1c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:24.608689 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5162651-a5ac-4ea3-ae1d-cd321242ba1c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:24.610120 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5162651-a5ac-4ea3-ae1d-cd321242ba1c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:24.610575 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5162651-a5ac-4ea3-ae1d-cd321242ba1c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:24.698883 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d22700be-c8aa-4fae-9b92-f372b6ab4ba7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:24.699898 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d22700be-c8aa-4fae-9b92-f372b6ab4ba7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:24.707057 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d22700be-c8aa-4fae-9b92-f372b6ab4ba7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:24.707500 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d22700be-c8aa-4fae-9b92-f372b6ab4ba7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:24.708276 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d22700be-c8aa-4fae-9b92-f372b6ab4ba7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:24.708704 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d22700be-c8aa-4fae-9b92-f372b6ab4ba7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:24.756312 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a5162651-a5ac-4ea3-ae1d-cd321242ba1c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:04:24.764199 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a5162651-a5ac-4ea3-ae1d-cd321242ba1c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1760 microversion: 2.1 time: 0.170867 Jan 05 15:04:24.764762 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 375/741] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:04:24 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1760 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:24.796023 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d22700be-c8aa-4fae-9b92-f372b6ab4ba7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 14 microversion: 2.1 time: 0.100992 Jan 05 15:04:24.797264 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 367/742] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:24 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:04:25.101336 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-feb7c07b-256e-470b-9cb2-6fa638b55267 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:25.102250 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-feb7c07b-256e-470b-9cb2-6fa638b55267 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:25.109844 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-feb7c07b-256e-470b-9cb2-6fa638b55267 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:25.110285 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-feb7c07b-256e-470b-9cb2-6fa638b55267 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:25.111052 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-feb7c07b-256e-470b-9cb2-6fa638b55267 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:25.111477 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-feb7c07b-256e-470b-9cb2-6fa638b55267 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:25.211621 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-feb7c07b-256e-470b-9cb2-6fa638b55267 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 14 microversion: 2.20 time: 0.113951 Jan 05 15:04:25.212246 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 376/743] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:25 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:25.808296 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a348eb95-a68e-4021-99e3-743afa008703 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:25.809257 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a348eb95-a68e-4021-99e3-743afa008703 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:25.816624 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a348eb95-a68e-4021-99e3-743afa008703 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:25.817092 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a348eb95-a68e-4021-99e3-743afa008703 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:25.817892 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a348eb95-a68e-4021-99e3-743afa008703 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:25.818329 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a348eb95-a68e-4021-99e3-743afa008703 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:25.915249 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a348eb95-a68e-4021-99e3-743afa008703 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 2006 microversion: 2.1 time: 0.110893 Jan 05 15:04:25.916500 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 368/744] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:25 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 2006 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:26.223281 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-70e6131a-17c9-4cf8-8942-a414f2e0f279 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:26.224289 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-70e6131a-17c9-4cf8-8942-a414f2e0f279 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:26.231430 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70e6131a-17c9-4cf8-8942-a414f2e0f279 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:26.234273 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70e6131a-17c9-4cf8-8942-a414f2e0f279 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:26.234273 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70e6131a-17c9-4cf8-8942-a414f2e0f279 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:26.234273 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70e6131a-17c9-4cf8-8942-a414f2e0f279 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:26.484758 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-70e6131a-17c9-4cf8-8942-a414f2e0f279 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 14 microversion: 2.20 time: 0.264819 Jan 05 15:04:26.485430 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 377/745] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:26 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 14 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:26.926589 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-104b072f-722b-4753-9e23-0843fc5074c6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:26.927610 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-104b072f-722b-4753-9e23-0843fc5074c6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:26.934344 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-104b072f-722b-4753-9e23-0843fc5074c6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:26.934784 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-104b072f-722b-4753-9e23-0843fc5074c6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:26.935556 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-104b072f-722b-4753-9e23-0843fc5074c6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:26.936007 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-104b072f-722b-4753-9e23-0843fc5074c6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:27.032657 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-104b072f-722b-4753-9e23-0843fc5074c6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 12331 microversion: 2.1 time: 0.109956 Jan 05 15:04:27.033342 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 369/746] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:26 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 12331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:27.499946 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de436a6f-3ae4-4d43-829e-3c0020a565df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:27.500956 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-de436a6f-3ae4-4d43-829e-3c0020a565df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:27.512671 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de436a6f-3ae4-4d43-829e-3c0020a565df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:27.512896 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de436a6f-3ae4-4d43-829e-3c0020a565df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:27.513709 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de436a6f-3ae4-4d43-829e-3c0020a565df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:27.514157 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de436a6f-3ae4-4d43-829e-3c0020a565df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:27.610162 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-de436a6f-3ae4-4d43-829e-3c0020a565df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 14 microversion: 2.20 time: 0.114705 Jan 05 15:04:27.610941 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 378/747] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:27 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:28.044315 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2806a746-a003-4b63-94bf-01ef380e1532 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:28.045269 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2806a746-a003-4b63-94bf-01ef380e1532 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:28.054439 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2806a746-a003-4b63-94bf-01ef380e1532 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:28.066322 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2806a746-a003-4b63-94bf-01ef380e1532 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:28.066322 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2806a746-a003-4b63-94bf-01ef380e1532 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:28.066322 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2806a746-a003-4b63-94bf-01ef380e1532 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:28.160055 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2806a746-a003-4b63-94bf-01ef380e1532 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 17861 microversion: 2.1 time: 0.119686 Jan 05 15:04:28.160692 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 370/748] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:28 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 17861 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:28.621686 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-30b89177-ebe0-4ae5-9d99-8f931ee7053f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:28.622680 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-30b89177-ebe0-4ae5-9d99-8f931ee7053f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:28.629937 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30b89177-ebe0-4ae5-9d99-8f931ee7053f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:28.630386 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30b89177-ebe0-4ae5-9d99-8f931ee7053f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:28.631158 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30b89177-ebe0-4ae5-9d99-8f931ee7053f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:28.631594 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30b89177-ebe0-4ae5-9d99-8f931ee7053f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:28.725619 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-30b89177-ebe0-4ae5-9d99-8f931ee7053f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 14 microversion: 2.20 time: 0.107832 Jan 05 15:04:28.726149 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 379/749] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:28 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:04:29.172501 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f5e6b18d-0573-4803-8f45-c573c117eac8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:29.173562 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f5e6b18d-0573-4803-8f45-c573c117eac8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:29.180411 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f5e6b18d-0573-4803-8f45-c573c117eac8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:29.181423 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f5e6b18d-0573-4803-8f45-c573c117eac8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:29.181826 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f5e6b18d-0573-4803-8f45-c573c117eac8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:29.182263 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f5e6b18d-0573-4803-8f45-c573c117eac8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:29.314420 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f5e6b18d-0573-4803-8f45-c573c117eac8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 18013 microversion: 2.1 time: 0.146339 Jan 05 15:04:29.315290 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 371/750] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:29 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 18013 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:29.736865 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d334510-b5a9-4d94-829c-bdde18a52934 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:29.737898 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3d334510-b5a9-4d94-829c-bdde18a52934 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:29.744579 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d334510-b5a9-4d94-829c-bdde18a52934 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:29.745021 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d334510-b5a9-4d94-829c-bdde18a52934 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:29.745845 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d334510-b5a9-4d94-829c-bdde18a52934 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:29.746273 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d334510-b5a9-4d94-829c-bdde18a52934 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:29.855944 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3d334510-b5a9-4d94-829c-bdde18a52934 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 6257 microversion: 2.20 time: 0.123719 Jan 05 15:04:29.856589 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 380/751] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:29 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 6257 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:04:30.327025 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-638c94e7-4377-402f-a53d-bc6a3c2cb51f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:30.328139 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-638c94e7-4377-402f-a53d-bc6a3c2cb51f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:30.335074 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-638c94e7-4377-402f-a53d-bc6a3c2cb51f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:30.335607 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-638c94e7-4377-402f-a53d-bc6a3c2cb51f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:30.336476 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-638c94e7-4377-402f-a53d-bc6a3c2cb51f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:30.337010 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-638c94e7-4377-402f-a53d-bc6a3c2cb51f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:30.451240 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-638c94e7-4377-402f-a53d-bc6a3c2cb51f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 20675 microversion: 2.1 time: 0.128933 Jan 05 15:04:30.451662 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 372/752] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:30 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 20675 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:30.867480 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-73dd46ff-c26b-48e8-878f-5d294d899ccb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:30.868587 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-73dd46ff-c26b-48e8-878f-5d294d899ccb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:30.875571 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73dd46ff-c26b-48e8-878f-5d294d899ccb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:30.876793 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73dd46ff-c26b-48e8-878f-5d294d899ccb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:30.876985 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73dd46ff-c26b-48e8-878f-5d294d899ccb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:30.877446 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73dd46ff-c26b-48e8-878f-5d294d899ccb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:30.987553 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-73dd46ff-c26b-48e8-878f-5d294d899ccb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 13513 microversion: 2.20 time: 0.123626 Jan 05 15:04:30.988483 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 381/753] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:30 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 13513 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:31.463585 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-172f1231-49ae-415c-84e6-346460a239d2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:31.464687 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-172f1231-49ae-415c-84e6-346460a239d2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:31.472570 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-172f1231-49ae-415c-84e6-346460a239d2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:31.473352 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-172f1231-49ae-415c-84e6-346460a239d2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:31.474150 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-172f1231-49ae-415c-84e6-346460a239d2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:31.474589 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-172f1231-49ae-415c-84e6-346460a239d2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:31.652784 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-172f1231-49ae-415c-84e6-346460a239d2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 22804 microversion: 2.1 time: 0.193025 Jan 05 15:04:31.657040 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 373/754] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:31 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 22804 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:31.998412 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-66656488-33bd-424f-b22f-1b04625778ad tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:32.000067 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-66656488-33bd-424f-b22f-1b04625778ad tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:32.007144 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66656488-33bd-424f-b22f-1b04625778ad tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:32.007592 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66656488-33bd-424f-b22f-1b04625778ad tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:32.008434 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66656488-33bd-424f-b22f-1b04625778ad tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:32.008867 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66656488-33bd-424f-b22f-1b04625778ad tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:32.137693 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-66656488-33bd-424f-b22f-1b04625778ad tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 18102 microversion: 2.20 time: 0.143141 Jan 05 15:04:32.138335 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 382/755] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:31 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 18102 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:32.664746 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1a59b6ca-e3b7-4a25-a1c4-34c67f69ad4d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:32.665817 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1a59b6ca-e3b7-4a25-a1c4-34c67f69ad4d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:32.673388 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1a59b6ca-e3b7-4a25-a1c4-34c67f69ad4d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:32.673839 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1a59b6ca-e3b7-4a25-a1c4-34c67f69ad4d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:32.674619 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1a59b6ca-e3b7-4a25-a1c4-34c67f69ad4d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:32.675072 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1a59b6ca-e3b7-4a25-a1c4-34c67f69ad4d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:32.771009 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1a59b6ca-e3b7-4a25-a1c4-34c67f69ad4d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 23804 microversion: 2.1 time: 0.110270 Jan 05 15:04:32.771857 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 374/756] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:32 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 23804 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:33.152334 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56601791-3436-4f67-b040-6516f171e26d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:33.153382 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-56601791-3436-4f67-b040-6516f171e26d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:33.170016 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56601791-3436-4f67-b040-6516f171e26d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:33.170470 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56601791-3436-4f67-b040-6516f171e26d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:33.171272 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56601791-3436-4f67-b040-6516f171e26d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:33.171708 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56601791-3436-4f67-b040-6516f171e26d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:33.284179 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-56601791-3436-4f67-b040-6516f171e26d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 19133 microversion: 2.20 time: 0.137758 Jan 05 15:04:33.284913 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 383/757] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:33 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 19133 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:33.783721 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ec1688e4-5c41-4676-97ea-50b6318c6191 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:33.784726 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ec1688e4-5c41-4676-97ea-50b6318c6191 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:33.791565 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ec1688e4-5c41-4676-97ea-50b6318c6191 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:33.792017 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ec1688e4-5c41-4676-97ea-50b6318c6191 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:33.792796 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ec1688e4-5c41-4676-97ea-50b6318c6191 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:33.793267 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ec1688e4-5c41-4676-97ea-50b6318c6191 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:33.887248 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ec1688e4-5c41-4676-97ea-50b6318c6191 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 24804 microversion: 2.1 time: 0.108009 Jan 05 15:04:33.887894 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 375/758] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:33 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 24804 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:34.295644 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-12b99a5b-7438-45b6-8d3e-0ccefc786b11 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:34.297335 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-12b99a5b-7438-45b6-8d3e-0ccefc786b11 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:34.304067 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12b99a5b-7438-45b6-8d3e-0ccefc786b11 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:34.304511 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12b99a5b-7438-45b6-8d3e-0ccefc786b11 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:34.305302 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12b99a5b-7438-45b6-8d3e-0ccefc786b11 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:34.305728 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12b99a5b-7438-45b6-8d3e-0ccefc786b11 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:34.407174 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-12b99a5b-7438-45b6-8d3e-0ccefc786b11 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 21119 microversion: 2.20 time: 0.115394 Jan 05 15:04:34.407843 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 384/759] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:34 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 21119 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:34.899721 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-02452dfe-ec89-4838-abb4-627d42845554 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:34.900722 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-02452dfe-ec89-4838-abb4-627d42845554 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:34.908105 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-02452dfe-ec89-4838-abb4-627d42845554 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:34.908550 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-02452dfe-ec89-4838-abb4-627d42845554 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:34.909342 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-02452dfe-ec89-4838-abb4-627d42845554 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:34.909798 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-02452dfe-ec89-4838-abb4-627d42845554 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:35.007130 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-02452dfe-ec89-4838-abb4-627d42845554 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 26037 microversion: 2.1 time: 0.111238 Jan 05 15:04:35.012429 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 376/760] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:34 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 26037 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:04:35.419146 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-62c7bace-dbcd-4372-8b83-523ae78eaed7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:35.420059 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-62c7bace-dbcd-4372-8b83-523ae78eaed7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:35.426949 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62c7bace-dbcd-4372-8b83-523ae78eaed7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:35.427390 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62c7bace-dbcd-4372-8b83-523ae78eaed7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:35.428162 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62c7bace-dbcd-4372-8b83-523ae78eaed7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:35.428590 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62c7bace-dbcd-4372-8b83-523ae78eaed7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:35.540511 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-62c7bace-dbcd-4372-8b83-523ae78eaed7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 22896 microversion: 2.20 time: 0.125290 Jan 05 15:04:35.541231 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 385/761] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:35 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 22896 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:36.186409 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-04359941-77c1-40e9-85fd-562035d87ab5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:36.187623 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-04359941-77c1-40e9-85fd-562035d87ab5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:36.193692 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-04359941-77c1-40e9-85fd-562035d87ab5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:36.195006 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-04359941-77c1-40e9-85fd-562035d87ab5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:36.195006 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-04359941-77c1-40e9-85fd-562035d87ab5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:36.195486 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-04359941-77c1-40e9-85fd-562035d87ab5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:36.294323 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-04359941-77c1-40e9-85fd-562035d87ab5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 27150 microversion: 2.1 time: 0.278724 Jan 05 15:04:36.300286 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 377/762] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:36 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 27150 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:36.555335 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-714d2116-aeb1-4351-b165-ce4dbf3b9854 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:36.556254 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-714d2116-aeb1-4351-b165-ce4dbf3b9854 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:36.563131 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-714d2116-aeb1-4351-b165-ce4dbf3b9854 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:36.563577 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-714d2116-aeb1-4351-b165-ce4dbf3b9854 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:36.564343 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-714d2116-aeb1-4351-b165-ce4dbf3b9854 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:36.564780 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-714d2116-aeb1-4351-b165-ce4dbf3b9854 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:36.669268 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-714d2116-aeb1-4351-b165-ce4dbf3b9854 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 24104 microversion: 2.20 time: 0.117926 Jan 05 15:04:36.669905 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 386/763] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:36 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 24104 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:37.307983 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-21589d23-4fcd-4311-9589-9a5603e1a453 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:37.309123 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-21589d23-4fcd-4311-9589-9a5603e1a453 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:37.316440 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-21589d23-4fcd-4311-9589-9a5603e1a453 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:37.316889 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-21589d23-4fcd-4311-9589-9a5603e1a453 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:37.317727 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-21589d23-4fcd-4311-9589-9a5603e1a453 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:37.318153 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-21589d23-4fcd-4311-9589-9a5603e1a453 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:37.413673 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-21589d23-4fcd-4311-9589-9a5603e1a453 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 27544 microversion: 2.1 time: 0.109551 Jan 05 15:04:37.414628 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 378/764] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:37 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 27544 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:37.679938 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c6e1f02-0712-47e9-adc3-72350ff8ed66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:37.680959 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1c6e1f02-0712-47e9-adc3-72350ff8ed66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:37.687448 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c6e1f02-0712-47e9-adc3-72350ff8ed66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:37.687897 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c6e1f02-0712-47e9-adc3-72350ff8ed66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:37.688672 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c6e1f02-0712-47e9-adc3-72350ff8ed66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:37.689149 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c6e1f02-0712-47e9-adc3-72350ff8ed66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:37.788634 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c6e1f02-0712-47e9-adc3-72350ff8ed66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 25216 microversion: 2.20 time: 0.112460 Jan 05 15:04:37.789608 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 387/765] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:37 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 25216 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:38.425759 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b3e2996b-ba84-4799-90cd-e283f7c1333c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:38.426772 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b3e2996b-ba84-4799-90cd-e283f7c1333c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:38.434688 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b3e2996b-ba84-4799-90cd-e283f7c1333c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:38.435135 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b3e2996b-ba84-4799-90cd-e283f7c1333c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:38.435925 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b3e2996b-ba84-4799-90cd-e283f7c1333c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:38.436359 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b3e2996b-ba84-4799-90cd-e283f7c1333c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:38.545466 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b3e2996b-ba84-4799-90cd-e283f7c1333c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 27854 microversion: 2.1 time: 0.123317 Jan 05 15:04:38.546141 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 379/766] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:38 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 27854 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:38.801025 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9f3e1300-de7e-4f5a-a4a9-bedc21059a15 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:38.801961 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9f3e1300-de7e-4f5a-a4a9-bedc21059a15 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:38.809354 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f3e1300-de7e-4f5a-a4a9-bedc21059a15 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:38.809802 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f3e1300-de7e-4f5a-a4a9-bedc21059a15 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:38.810622 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f3e1300-de7e-4f5a-a4a9-bedc21059a15 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:38.811049 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f3e1300-de7e-4f5a-a4a9-bedc21059a15 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:38.911676 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9f3e1300-de7e-4f5a-a4a9-bedc21059a15 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 26377 microversion: 2.20 time: 0.115220 Jan 05 15:04:38.912357 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 388/767] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:38 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 26377 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:39.557912 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-017685d1-7e11-4195-b4f6-691dfbcfd9fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:39.558953 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-017685d1-7e11-4195-b4f6-691dfbcfd9fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:39.565768 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-017685d1-7e11-4195-b4f6-691dfbcfd9fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:39.566217 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-017685d1-7e11-4195-b4f6-691dfbcfd9fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:39.566997 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-017685d1-7e11-4195-b4f6-691dfbcfd9fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:39.567433 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-017685d1-7e11-4195-b4f6-691dfbcfd9fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:39.666139 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-017685d1-7e11-4195-b4f6-691dfbcfd9fc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 28218 microversion: 2.1 time: 0.112044 Jan 05 15:04:39.666788 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 380/768] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:39 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 28218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:39.923521 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6c8112c6-8caa-4501-98df-9e2e352a675a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:39.924515 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6c8112c6-8caa-4501-98df-9e2e352a675a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:39.931319 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c8112c6-8caa-4501-98df-9e2e352a675a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:39.931811 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c8112c6-8caa-4501-98df-9e2e352a675a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:39.932623 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c8112c6-8caa-4501-98df-9e2e352a675a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:39.933058 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c8112c6-8caa-4501-98df-9e2e352a675a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:40.060575 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6c8112c6-8caa-4501-98df-9e2e352a675a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 27144 microversion: 2.20 time: 0.141049 Jan 05 15:04:40.061511 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 389/769] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:39 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 27144 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:40.678795 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7f25859e-6ec9-495d-adb0-d92758b34d21 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:40.679904 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7f25859e-6ec9-495d-adb0-d92758b34d21 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:40.686672 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7f25859e-6ec9-495d-adb0-d92758b34d21 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:40.687214 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7f25859e-6ec9-495d-adb0-d92758b34d21 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:40.688063 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7f25859e-6ec9-495d-adb0-d92758b34d21 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:40.688501 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7f25859e-6ec9-495d-adb0-d92758b34d21 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:40.781828 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7f25859e-6ec9-495d-adb0-d92758b34d21 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 28218 microversion: 2.1 time: 0.107222 Jan 05 15:04:40.788136 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 381/770] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:40 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 28218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:41.072178 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8c22ce2b-afb1-4ee9-824d-86a7a715f507 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:41.073200 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8c22ce2b-afb1-4ee9-824d-86a7a715f507 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:41.080511 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c22ce2b-afb1-4ee9-824d-86a7a715f507 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:41.080957 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c22ce2b-afb1-4ee9-824d-86a7a715f507 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:41.081949 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c22ce2b-afb1-4ee9-824d-86a7a715f507 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:41.082193 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c22ce2b-afb1-4ee9-824d-86a7a715f507 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:41.187863 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8c22ce2b-afb1-4ee9-824d-86a7a715f507 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 27729 microversion: 2.20 time: 0.119472 Jan 05 15:04:41.188518 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 390/771] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:41 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 27729 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:41.800041 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6db4216e-2553-4ddf-9019-3d4a2ef68498 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:41.800973 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-6db4216e-2553-4ddf-9019-3d4a2ef68498 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:41.807953 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6db4216e-2553-4ddf-9019-3d4a2ef68498 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:41.810965 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6db4216e-2553-4ddf-9019-3d4a2ef68498 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:41.810965 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6db4216e-2553-4ddf-9019-3d4a2ef68498 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:41.810965 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6db4216e-2553-4ddf-9019-3d4a2ef68498 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:41.909548 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6db4216e-2553-4ddf-9019-3d4a2ef68498 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 28509 microversion: 2.1 time: 0.113427 Jan 05 15:04:41.910185 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 382/772] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:41 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 28509 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:42.200325 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-43d66514-ce36-462d-b802-9b001de5d7ef tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:42.201364 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-43d66514-ce36-462d-b802-9b001de5d7ef tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:42.208826 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d66514-ce36-462d-b802-9b001de5d7ef tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:42.212493 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d66514-ce36-462d-b802-9b001de5d7ef tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:42.212493 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d66514-ce36-462d-b802-9b001de5d7ef tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:42.212493 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d66514-ce36-462d-b802-9b001de5d7ef tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:42.317394 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-43d66514-ce36-462d-b802-9b001de5d7ef tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 28024 microversion: 2.20 time: 0.120923 Jan 05 15:04:42.318020 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 391/773] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:42 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 28024 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:42.921691 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-17549b1a-88da-422f-bad5-c6eeb536cd6f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:42.922702 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-17549b1a-88da-422f-bad5-c6eeb536cd6f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:42.930228 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-17549b1a-88da-422f-bad5-c6eeb536cd6f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:42.930695 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-17549b1a-88da-422f-bad5-c6eeb536cd6f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:42.931451 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-17549b1a-88da-422f-bad5-c6eeb536cd6f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:42.931889 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-17549b1a-88da-422f-bad5-c6eeb536cd6f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:43.035304 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-17549b1a-88da-422f-bad5-c6eeb536cd6f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 28509 microversion: 2.1 time: 0.117418 Jan 05 15:04:43.036228 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 383/774] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:42 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 28509 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:43.329642 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1ac8f01e-35d9-4292-9be7-a38ceac30463 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:43.331163 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1ac8f01e-35d9-4292-9be7-a38ceac30463 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:43.338021 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ac8f01e-35d9-4292-9be7-a38ceac30463 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:43.338471 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ac8f01e-35d9-4292-9be7-a38ceac30463 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:43.339245 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ac8f01e-35d9-4292-9be7-a38ceac30463 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:43.339676 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ac8f01e-35d9-4292-9be7-a38ceac30463 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:43.436114 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1ac8f01e-35d9-4292-9be7-a38ceac30463 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 28210 microversion: 2.20 time: 0.110561 Jan 05 15:04:43.437269 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 392/775] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:43 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 28210 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:44.047377 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-be1fa46c-35af-455c-91e3-45203bd46247 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:44.048388 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-be1fa46c-35af-455c-91e3-45203bd46247 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:44.055667 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-be1fa46c-35af-455c-91e3-45203bd46247 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:44.056116 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-be1fa46c-35af-455c-91e3-45203bd46247 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:44.056901 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-be1fa46c-35af-455c-91e3-45203bd46247 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:44.057360 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-be1fa46c-35af-455c-91e3-45203bd46247 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:44.166004 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-be1fa46c-35af-455c-91e3-45203bd46247 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 28677 microversion: 2.1 time: 0.122465 Jan 05 15:04:44.166677 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 384/776] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:44 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 28677 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:44.448579 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c548ef0f-2b59-4ef0-af8c-5b5d2845c57f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:44.449609 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c548ef0f-2b59-4ef0-af8c-5b5d2845c57f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:44.456987 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c548ef0f-2b59-4ef0-af8c-5b5d2845c57f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:44.457474 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c548ef0f-2b59-4ef0-af8c-5b5d2845c57f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:44.458259 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c548ef0f-2b59-4ef0-af8c-5b5d2845c57f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:44.458704 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c548ef0f-2b59-4ef0-af8c-5b5d2845c57f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:44.548301 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c548ef0f-2b59-4ef0-af8c-5b5d2845c57f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 28210 microversion: 2.20 time: 0.103864 Jan 05 15:04:44.548965 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 393/777] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:44 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 28210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:45.178172 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-38ba1f44-7b24-4069-b22a-59aaba3bd130 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:45.179166 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-38ba1f44-7b24-4069-b22a-59aaba3bd130 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:45.186149 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-38ba1f44-7b24-4069-b22a-59aaba3bd130 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:45.186907 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-38ba1f44-7b24-4069-b22a-59aaba3bd130 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:45.190836 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-38ba1f44-7b24-4069-b22a-59aaba3bd130 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:45.190836 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-38ba1f44-7b24-4069-b22a-59aaba3bd130 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:45.279858 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-38ba1f44-7b24-4069-b22a-59aaba3bd130 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 28677 microversion: 2.1 time: 0.105548 Jan 05 15:04:45.280393 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 385/778] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:45 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 28677 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:45.719611 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6f44f172-3803-48bd-99e9-2f8d684b9cf4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:45.720644 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6f44f172-3803-48bd-99e9-2f8d684b9cf4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:45.727194 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f44f172-3803-48bd-99e9-2f8d684b9cf4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:45.727641 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f44f172-3803-48bd-99e9-2f8d684b9cf4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:45.728688 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f44f172-3803-48bd-99e9-2f8d684b9cf4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:45.729153 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f44f172-3803-48bd-99e9-2f8d684b9cf4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:45.834737 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6f44f172-3803-48bd-99e9-2f8d684b9cf4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 28501 microversion: 2.20 time: 0.278326 Jan 05 15:04:45.835329 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 394/779] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:45 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 28501 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:46.291883 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e31ee3c7-81a1-4eac-b074-1af511f25323 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:46.292951 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e31ee3c7-81a1-4eac-b074-1af511f25323 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:46.299907 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e31ee3c7-81a1-4eac-b074-1af511f25323 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:46.300360 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e31ee3c7-81a1-4eac-b074-1af511f25323 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:46.301172 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e31ee3c7-81a1-4eac-b074-1af511f25323 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:46.301613 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e31ee3c7-81a1-4eac-b074-1af511f25323 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:46.400521 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e31ee3c7-81a1-4eac-b074-1af511f25323 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 28677 microversion: 2.1 time: 0.112640 Jan 05 15:04:46.401188 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 386/780] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:46 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 28677 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:46.846822 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-07b85ef0-6448-464f-b5e0-546fd738b4ae tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:46.847853 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-07b85ef0-6448-464f-b5e0-546fd738b4ae tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:46.855197 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07b85ef0-6448-464f-b5e0-546fd738b4ae tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:46.855637 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07b85ef0-6448-464f-b5e0-546fd738b4ae tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:46.856402 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07b85ef0-6448-464f-b5e0-546fd738b4ae tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:46.856830 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07b85ef0-6448-464f-b5e0-546fd738b4ae tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:46.968882 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-07b85ef0-6448-464f-b5e0-546fd738b4ae tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 28669 microversion: 2.20 time: 0.125935 Jan 05 15:04:46.969745 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 395/781] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:46 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 28669 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:47.412613 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-5001fef4-41ee-4b3b-8ae5-038b10524386 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:47.413504 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-5001fef4-41ee-4b3b-8ae5-038b10524386 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:47.420394 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5001fef4-41ee-4b3b-8ae5-038b10524386 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:47.420846 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5001fef4-41ee-4b3b-8ae5-038b10524386 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:47.421657 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5001fef4-41ee-4b3b-8ae5-038b10524386 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:47.422263 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5001fef4-41ee-4b3b-8ae5-038b10524386 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:47.514364 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-5001fef4-41ee-4b3b-8ae5-038b10524386 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 28677 microversion: 2.1 time: 0.106129 Jan 05 15:04:47.515280 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 387/782] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:47 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 28677 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:47.980633 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0982e805-688b-474d-a5ee-8e418f58e5ba tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:47.981669 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0982e805-688b-474d-a5ee-8e418f58e5ba tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:47.988536 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0982e805-688b-474d-a5ee-8e418f58e5ba tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:47.988923 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0982e805-688b-474d-a5ee-8e418f58e5ba tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:47.989723 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0982e805-688b-474d-a5ee-8e418f58e5ba tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:47.990156 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0982e805-688b-474d-a5ee-8e418f58e5ba tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:48.078956 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0982e805-688b-474d-a5ee-8e418f58e5ba tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 28669 microversion: 2.20 time: 0.102545 Jan 05 15:04:48.079769 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 396/783] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:47 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 28669 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:48.526466 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-96b0898f-5da2-48d6-b641-0fc54d12981f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:48.527472 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-96b0898f-5da2-48d6-b641-0fc54d12981f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:48.534633 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96b0898f-5da2-48d6-b641-0fc54d12981f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:48.538262 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96b0898f-5da2-48d6-b641-0fc54d12981f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:48.538262 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96b0898f-5da2-48d6-b641-0fc54d12981f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:48.538262 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96b0898f-5da2-48d6-b641-0fc54d12981f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:48.636154 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-96b0898f-5da2-48d6-b641-0fc54d12981f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 28848 microversion: 2.1 time: 0.113520 Jan 05 15:04:48.637553 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 388/784] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:48 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 28848 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:49.091872 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-088c70ae-f89d-4bf6-b560-174ca3785ed3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:49.092913 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-088c70ae-f89d-4bf6-b560-174ca3785ed3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:49.100330 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-088c70ae-f89d-4bf6-b560-174ca3785ed3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:49.100785 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-088c70ae-f89d-4bf6-b560-174ca3785ed3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:49.101610 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-088c70ae-f89d-4bf6-b560-174ca3785ed3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:49.102046 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-088c70ae-f89d-4bf6-b560-174ca3785ed3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:49.198967 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-088c70ae-f89d-4bf6-b560-174ca3785ed3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 28669 microversion: 2.20 time: 0.110941 Jan 05 15:04:49.199794 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 397/785] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:49 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 28669 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:49.648821 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c1ee35bb-1b28-4255-8cab-9e720df8ee8b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:49.649843 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c1ee35bb-1b28-4255-8cab-9e720df8ee8b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:49.656599 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c1ee35bb-1b28-4255-8cab-9e720df8ee8b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:49.657044 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c1ee35bb-1b28-4255-8cab-9e720df8ee8b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:49.657841 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c1ee35bb-1b28-4255-8cab-9e720df8ee8b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:49.658270 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c1ee35bb-1b28-4255-8cab-9e720df8ee8b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:49.760099 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c1ee35bb-1b28-4255-8cab-9e720df8ee8b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 30466 microversion: 2.1 time: 0.115176 Jan 05 15:04:49.760760 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 389/786] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:49 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 30466 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:50.211575 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5dd2551f-c8dc-4d08-b714-13fe8b59609d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:50.212579 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5dd2551f-c8dc-4d08-b714-13fe8b59609d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:50.219609 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5dd2551f-c8dc-4d08-b714-13fe8b59609d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:50.220053 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5dd2551f-c8dc-4d08-b714-13fe8b59609d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:50.220867 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5dd2551f-c8dc-4d08-b714-13fe8b59609d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:50.221322 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5dd2551f-c8dc-4d08-b714-13fe8b59609d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:50.308708 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5dd2551f-c8dc-4d08-b714-13fe8b59609d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 28669 microversion: 2.20 time: 0.101033 Jan 05 15:04:50.309307 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 398/787] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:50 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 28669 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:50.772217 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1e1ca665-d114-43ee-ae4a-5c201cfe216a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:50.773293 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1e1ca665-d114-43ee-ae4a-5c201cfe216a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:50.780027 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1e1ca665-d114-43ee-ae4a-5c201cfe216a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:50.780475 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1e1ca665-d114-43ee-ae4a-5c201cfe216a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:50.781282 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1e1ca665-d114-43ee-ae4a-5c201cfe216a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:50.781716 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1e1ca665-d114-43ee-ae4a-5c201cfe216a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:50.881341 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1e1ca665-d114-43ee-ae4a-5c201cfe216a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 32087 microversion: 2.1 time: 0.113055 Jan 05 15:04:50.883260 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 390/788] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:50 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 32087 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:51.320160 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8db0f572-deaa-497d-9787-b66ea4130911 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:51.321206 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8db0f572-deaa-497d-9787-b66ea4130911 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:51.328120 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8db0f572-deaa-497d-9787-b66ea4130911 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:51.328580 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8db0f572-deaa-497d-9787-b66ea4130911 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:51.329399 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8db0f572-deaa-497d-9787-b66ea4130911 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:51.330063 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8db0f572-deaa-497d-9787-b66ea4130911 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:51.438565 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8db0f572-deaa-497d-9787-b66ea4130911 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 29843 microversion: 2.20 time: 0.122314 Jan 05 15:04:51.439216 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 399/789] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:51 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 29843 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:51.902543 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7e4e4db4-6cd1-40ed-a2b7-789d0c3275bb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:51.903570 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7e4e4db4-6cd1-40ed-a2b7-789d0c3275bb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:51.910459 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7e4e4db4-6cd1-40ed-a2b7-789d0c3275bb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:51.910904 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7e4e4db4-6cd1-40ed-a2b7-789d0c3275bb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:51.911685 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7e4e4db4-6cd1-40ed-a2b7-789d0c3275bb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:51.912115 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7e4e4db4-6cd1-40ed-a2b7-789d0c3275bb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:52.008134 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7e4e4db4-6cd1-40ed-a2b7-789d0c3275bb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 33163 microversion: 2.1 time: 0.109416 Jan 05 15:04:52.009119 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 391/790] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:51 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 33163 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:52.451135 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-50ebbef1-db93-439e-805e-4e65847883c0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:52.451984 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-50ebbef1-db93-439e-805e-4e65847883c0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:52.458753 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ebbef1-db93-439e-805e-4e65847883c0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:52.459202 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ebbef1-db93-439e-805e-4e65847883c0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:52.459987 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ebbef1-db93-439e-805e-4e65847883c0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:52.460549 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ebbef1-db93-439e-805e-4e65847883c0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:52.563755 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-50ebbef1-db93-439e-805e-4e65847883c0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 31675 microversion: 2.20 time: 0.116600 Jan 05 15:04:52.564612 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 400/791] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:52 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 31675 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:53.020764 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-bc1bd8b8-f674-4671-b6e4-9167dc3bb2cf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:53.021786 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-bc1bd8b8-f674-4671-b6e4-9167dc3bb2cf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:53.028518 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bc1bd8b8-f674-4671-b6e4-9167dc3bb2cf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:53.028961 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bc1bd8b8-f674-4671-b6e4-9167dc3bb2cf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:53.029775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bc1bd8b8-f674-4671-b6e4-9167dc3bb2cf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:53.030194 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bc1bd8b8-f674-4671-b6e4-9167dc3bb2cf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:53.131550 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-bc1bd8b8-f674-4671-b6e4-9167dc3bb2cf tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 33919 microversion: 2.1 time: 0.115188 Jan 05 15:04:53.132488 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 392/792] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:53 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 33919 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:53.576332 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-44b6da08-3735-4b18-ba11-c0c9da152187 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:53.577372 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-44b6da08-3735-4b18-ba11-c0c9da152187 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:53.585010 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44b6da08-3735-4b18-ba11-c0c9da152187 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:53.585483 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44b6da08-3735-4b18-ba11-c0c9da152187 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:53.586251 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44b6da08-3735-4b18-ba11-c0c9da152187 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:53.586679 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44b6da08-3735-4b18-ba11-c0c9da152187 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:53.681040 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-44b6da08-3735-4b18-ba11-c0c9da152187 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 32506 microversion: 2.20 time: 0.108591 Jan 05 15:04:53.681841 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 401/793] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:53 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 32506 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:54.143499 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1d3a180b-0359-4876-bb6e-23e6cd589aed tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:54.144510 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1d3a180b-0359-4876-bb6e-23e6cd589aed tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:54.151344 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1d3a180b-0359-4876-bb6e-23e6cd589aed tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:54.151780 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1d3a180b-0359-4876-bb6e-23e6cd589aed tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:54.152545 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1d3a180b-0359-4876-bb6e-23e6cd589aed tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:54.152974 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1d3a180b-0359-4876-bb6e-23e6cd589aed tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:54.249092 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1d3a180b-0359-4876-bb6e-23e6cd589aed tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 34997 microversion: 2.1 time: 0.109670 Jan 05 15:04:54.249717 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 393/794] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:54 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 34997 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:54.694528 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c9ef73e-bcbf-4c2b-b49a-ffe26bf4aef5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:54.695523 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1c9ef73e-bcbf-4c2b-b49a-ffe26bf4aef5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:54.702377 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c9ef73e-bcbf-4c2b-b49a-ffe26bf4aef5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:54.702888 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c9ef73e-bcbf-4c2b-b49a-ffe26bf4aef5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:54.703689 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c9ef73e-bcbf-4c2b-b49a-ffe26bf4aef5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:54.704118 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c9ef73e-bcbf-4c2b-b49a-ffe26bf4aef5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:54.800680 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c9ef73e-bcbf-4c2b-b49a-ffe26bf4aef5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 33270 microversion: 2.20 time: 0.110557 Jan 05 15:04:54.801243 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 402/795] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:54 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 33270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:55.262097 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-598be8b0-60a6-41c5-863e-83a7e8049e7a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:55.263159 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-598be8b0-60a6-41c5-863e-83a7e8049e7a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:55.270031 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-598be8b0-60a6-41c5-863e-83a7e8049e7a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:55.270479 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-598be8b0-60a6-41c5-863e-83a7e8049e7a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:55.271254 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-598be8b0-60a6-41c5-863e-83a7e8049e7a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:55.271683 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-598be8b0-60a6-41c5-863e-83a7e8049e7a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:55.376423 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-598be8b0-60a6-41c5-863e-83a7e8049e7a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 36176 microversion: 2.1 time: 0.118165 Jan 05 15:04:55.377291 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 394/796] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:55 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 36176 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:55.812640 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4d894a17-7b2b-4489-9570-575693ea030f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:55.813710 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4d894a17-7b2b-4489-9570-575693ea030f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:55.820492 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d894a17-7b2b-4489-9570-575693ea030f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:55.820922 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d894a17-7b2b-4489-9570-575693ea030f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:55.821721 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d894a17-7b2b-4489-9570-575693ea030f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:55.822152 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d894a17-7b2b-4489-9570-575693ea030f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:55.928207 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4d894a17-7b2b-4489-9570-575693ea030f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 34146 microversion: 2.20 time: 0.119535 Jan 05 15:04:55.928836 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 403/797] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:55 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 34146 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:04:56.389127 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-9f4edc2f-76d5-4643-80be-a03968009782 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:56.390142 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-9f4edc2f-76d5-4643-80be-a03968009782 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:56.397606 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9f4edc2f-76d5-4643-80be-a03968009782 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:56.398058 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9f4edc2f-76d5-4643-80be-a03968009782 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:56.398834 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9f4edc2f-76d5-4643-80be-a03968009782 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:56.399274 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9f4edc2f-76d5-4643-80be-a03968009782 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:56.500096 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-9f4edc2f-76d5-4643-80be-a03968009782 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 37576 microversion: 2.1 time: 0.114908 Jan 05 15:04:56.500731 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 395/798] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:56 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 37576 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:56.940754 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8536b7ed-cd7f-426e-b698-92dc988837c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:56.941797 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8536b7ed-cd7f-426e-b698-92dc988837c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:56.949296 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8536b7ed-cd7f-426e-b698-92dc988837c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:56.949746 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8536b7ed-cd7f-426e-b698-92dc988837c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:56.950521 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8536b7ed-cd7f-426e-b698-92dc988837c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:56.950955 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8536b7ed-cd7f-426e-b698-92dc988837c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:57.042715 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8536b7ed-cd7f-426e-b698-92dc988837c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 35362 microversion: 2.20 time: 0.105941 Jan 05 15:04:57.043332 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 404/799] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:56 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 35362 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:57.512288 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-4c9b3ed7-bc7d-44b6-bcf2-637a17303dbe tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:57.513327 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-4c9b3ed7-bc7d-44b6-bcf2-637a17303dbe tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:57.520574 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4c9b3ed7-bc7d-44b6-bcf2-637a17303dbe tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:57.521039 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4c9b3ed7-bc7d-44b6-bcf2-637a17303dbe tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:57.521831 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4c9b3ed7-bc7d-44b6-bcf2-637a17303dbe tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:57.522264 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4c9b3ed7-bc7d-44b6-bcf2-637a17303dbe tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:57.618044 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-4c9b3ed7-bc7d-44b6-bcf2-637a17303dbe tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 38205 microversion: 2.1 time: 0.109705 Jan 05 15:04:57.618653 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 396/800] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:57 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 38205 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:58.055579 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f368719d-6e82-47dc-935f-6bd4251ffc16 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:58.056642 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f368719d-6e82-47dc-935f-6bd4251ffc16 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:58.063470 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f368719d-6e82-47dc-935f-6bd4251ffc16 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:58.063914 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f368719d-6e82-47dc-935f-6bd4251ffc16 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:58.064683 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f368719d-6e82-47dc-935f-6bd4251ffc16 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:58.065132 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f368719d-6e82-47dc-935f-6bd4251ffc16 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:58.165364 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f368719d-6e82-47dc-935f-6bd4251ffc16 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 36465 microversion: 2.20 time: 0.114217 Jan 05 15:04:58.165996 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 405/801] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:58 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 36465 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:58.629914 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-fc88c976-efef-4c20-8878-088c29ba6a4c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:58.630905 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-fc88c976-efef-4c20-8878-088c29ba6a4c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:58.637752 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fc88c976-efef-4c20-8878-088c29ba6a4c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:58.639731 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fc88c976-efef-4c20-8878-088c29ba6a4c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:58.639731 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fc88c976-efef-4c20-8878-088c29ba6a4c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:58.639731 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fc88c976-efef-4c20-8878-088c29ba6a4c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:58.725363 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-fc88c976-efef-4c20-8878-088c29ba6a4c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 38205 microversion: 2.1 time: 0.099360 Jan 05 15:04:58.725983 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 397/802] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:58 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 38205 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:04:59.177019 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-816c2ebe-d91f-4ed9-b444-60c78f48b300 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:59.178041 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-816c2ebe-d91f-4ed9-b444-60c78f48b300 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:59.184963 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-816c2ebe-d91f-4ed9-b444-60c78f48b300 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:59.189055 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-816c2ebe-d91f-4ed9-b444-60c78f48b300 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:59.189055 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-816c2ebe-d91f-4ed9-b444-60c78f48b300 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:59.189055 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-816c2ebe-d91f-4ed9-b444-60c78f48b300 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:59.279261 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-816c2ebe-d91f-4ed9-b444-60c78f48b300 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 37796 microversion: 2.20 time: 0.106149 Jan 05 15:04:59.279939 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 406/803] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:04:59 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 37796 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:04:59.737970 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6cbc3eae-91ea-487f-acda-0de06b6dd8e6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:04:59.738977 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-6cbc3eae-91ea-487f-acda-0de06b6dd8e6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:04:59.745862 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6cbc3eae-91ea-487f-acda-0de06b6dd8e6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:59.746312 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6cbc3eae-91ea-487f-acda-0de06b6dd8e6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:59.747104 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6cbc3eae-91ea-487f-acda-0de06b6dd8e6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:04:59.747532 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6cbc3eae-91ea-487f-acda-0de06b6dd8e6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:04:59.831400 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6cbc3eae-91ea-487f-acda-0de06b6dd8e6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 38205 microversion: 2.1 time: 0.097275 Jan 05 15:04:59.832194 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 398/804] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:04:59 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 38205 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:05:00.291907 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b2ae31f3-967a-4cca-824a-4e7bc30843c1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:00.292901 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b2ae31f3-967a-4cca-824a-4e7bc30843c1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:00.299702 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2ae31f3-967a-4cca-824a-4e7bc30843c1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:00.300144 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2ae31f3-967a-4cca-824a-4e7bc30843c1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:00.300912 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2ae31f3-967a-4cca-824a-4e7bc30843c1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:00.301860 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2ae31f3-967a-4cca-824a-4e7bc30843c1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:00.396573 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b2ae31f3-967a-4cca-824a-4e7bc30843c1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 38220 microversion: 2.20 time: 0.108634 Jan 05 15:05:00.397256 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 407/805] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:05:00 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 38220 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:05:00.844227 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-0a01be20-493f-4bea-b850-babd0c307875 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:00.845297 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0a01be20-493f-4bea-b850-babd0c307875 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:00.852586 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0a01be20-493f-4bea-b850-babd0c307875 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:00.853113 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0a01be20-493f-4bea-b850-babd0c307875 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:00.859043 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0a01be20-493f-4bea-b850-babd0c307875 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:00.859043 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0a01be20-493f-4bea-b850-babd0c307875 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:00.951719 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-0a01be20-493f-4bea-b850-babd0c307875 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action" status: 200 len: 38334 microversion: 2.1 time: 0.111419 Jan 05 15:05:00.952346 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 399/806] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:05:00 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/action => generated 38334 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:05:00.963016 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dd9a21c2-b9de-492f-809e-06e6bcd6c92e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:00.963590 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dd9a21c2-b9de-492f-809e-06e6bcd6c92e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:00.970383 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd9a21c2-b9de-492f-809e-06e6bcd6c92e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:00.970834 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd9a21c2-b9de-492f-809e-06e6bcd6c92e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:00.971609 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd9a21c2-b9de-492f-809e-06e6bcd6c92e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:00.972047 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd9a21c2-b9de-492f-809e-06e6bcd6c92e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:00.996773 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dd9a21c2-b9de-492f-809e-06e6bcd6c92e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/ips" status: 200 len: 145 microversion: 2.1 time: 0.037754 Jan 05 15:05:00.997369 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 408/807] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Jan 5 15:05:00 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:05:01.408909 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-9942e1d6-5c9f-4663-a3f1-00959a3cb419 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:01.409921 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-9942e1d6-5c9f-4663-a3f1-00959a3cb419 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:01.416418 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9942e1d6-5c9f-4663-a3f1-00959a3cb419 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:01.416864 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9942e1d6-5c9f-4663-a3f1-00959a3cb419 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:01.417704 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9942e1d6-5c9f-4663-a3f1-00959a3cb419 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:01.418142 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9942e1d6-5c9f-4663-a3f1-00959a3cb419 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:01.502783 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-9942e1d6-5c9f-4663-a3f1-00959a3cb419 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 38220 microversion: 2.20 time: 0.097892 Jan 05 15:05:01.503608 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 400/808] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:05:01 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 38220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:05:02.514466 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-21164746-34dd-4bb7-a841-6a51128d1ec6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:02.515378 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-21164746-34dd-4bb7-a841-6a51128d1ec6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:02.522213 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21164746-34dd-4bb7-a841-6a51128d1ec6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:02.522660 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21164746-34dd-4bb7-a841-6a51128d1ec6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:02.523429 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21164746-34dd-4bb7-a841-6a51128d1ec6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:02.523857 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21164746-34dd-4bb7-a841-6a51128d1ec6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:02.605311 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-21164746-34dd-4bb7-a841-6a51128d1ec6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 38220 microversion: 2.20 time: 0.094553 Jan 05 15:05:02.606197 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 409/809] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:05:02 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 38220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:05:02.633860 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-cb0fbca9-f943-4e9b-a30d-296aa3112849 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c409c2e-1459-485d-9878-749de6bc3e4e"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:02.634995 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-cb0fbca9-f943-4e9b-a30d-296aa3112849 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:02.641891 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cb0fbca9-f943-4e9b-a30d-296aa3112849 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:02.642333 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cb0fbca9-f943-4e9b-a30d-296aa3112849 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:02.643112 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cb0fbca9-f943-4e9b-a30d-296aa3112849 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:02.643547 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cb0fbca9-f943-4e9b-a30d-296aa3112849 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:03.332662 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-cb0fbca9-f943-4e9b-a30d-296aa3112849 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703359 Jan 05 15:05:03.333302 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 401/810] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Jan 5 15:05:02 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:05:03.617813 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b530069a-df25-4bc0-b505-d8afd67abd35 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:03.618803 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b530069a-df25-4bc0-b505-d8afd67abd35 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:03.625618 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b530069a-df25-4bc0-b505-d8afd67abd35 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:03.626056 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b530069a-df25-4bc0-b505-d8afd67abd35 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:03.626852 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b530069a-df25-4bc0-b505-d8afd67abd35 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:03.627276 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b530069a-df25-4bc0-b505-d8afd67abd35 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:03.722205 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b530069a-df25-4bc0-b505-d8afd67abd35 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 200 len: 38361 microversion: 2.20 time: 0.108250 Jan 05 15:05:03.723092 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 410/811] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:05:03 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 38361 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:05:03.734154 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-0d52fa79-b4c8-4d7a-a395-efa78101b4c3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:03.734936 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0d52fa79-b4c8-4d7a-a395-efa78101b4c3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:03.741530 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0d52fa79-b4c8-4d7a-a395-efa78101b4c3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:03.741975 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0d52fa79-b4c8-4d7a-a395-efa78101b4c3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:03.742951 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0d52fa79-b4c8-4d7a-a395-efa78101b4c3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:03.743378 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0d52fa79-b4c8-4d7a-a395-efa78101b4c3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:03.767043 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-0d52fa79-b4c8-4d7a-a395-efa78101b4c3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/ips" status: 200 len: 152 microversion: 2.20 time: 0.037600 Jan 05 15:05:03.767606 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 402/812] 10.222.0.30 () {60 vars in 1288 bytes} [Wed Jan 5 15:05:03 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 15:05:06.126108 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1780740953"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:06.126826 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:06.133932 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:06.134374 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:06.135333 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:06.135960 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:06.264924 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.network.security_group_api [None req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Removing security group 2767f584-b06b-4dab-a69f-33162778019e from port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 Jan 05 15:05:06.333772 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1dedfce7-02c2-4163-92a1-936835594481 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:06.334338 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1dedfce7-02c2-4163-92a1-936835594481 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:06.341248 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1dedfce7-02c2-4163-92a1-936835594481 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:06.341702 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1dedfce7-02c2-4163-92a1-936835594481 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:06.342486 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1dedfce7-02c2-4163-92a1-936835594481 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:06.343111 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1dedfce7-02c2-4163-92a1-936835594481 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:06.366179 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-1dedfce7-02c2-4163-92a1-936835594481 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lazy-loading 'flavor' on Instance uuid a591f495-ff59-4865-87ea-c48041ea097f {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:05:06.691860 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "POST /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/action" status: 202 len: 0 microversion: 2.1 time: 0.569957 Jan 05 15:05:06.693194 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 411/813] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:05:06 2022] POST /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:05:06.939266 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e86959c3-c57b-4e1e-a2c3-b42e95c56e3c req-28318c30-090f-4925-bb30-67466d8c60e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:06.940928 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:05:06.940928 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:05:06.965830 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e86959c3-c57b-4e1e-a2c3-b42e95c56e3c req-28318c30-090f-4925-bb30-67466d8c60e2 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:06.967393 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e86959c3-c57b-4e1e-a2c3-b42e95c56e3c req-28318c30-090f-4925-bb30-67466d8c60e2 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:06.978657 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e86959c3-c57b-4e1e-a2c3-b42e95c56e3c req-28318c30-090f-4925-bb30-67466d8c60e2 service nova] Creating event network-changed:4bda96b8-bc6e-4586-8d4d-5a66846e4b96 for instance 22497ce1-6400-4f16-a962-dce627a97693 on hv-cinder-maste Jan 05 15:05:06.984100 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1dedfce7-02c2-4163-92a1-936835594481 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 202 len: 0 microversion: 2.20 time: 0.653745 Jan 05 15:05:06.984259 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e86959c3-c57b-4e1e-a2c3-b42e95c56e3c req-28318c30-090f-4925-bb30-67466d8c60e2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.285964 Jan 05 15:05:06.987582 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 403/814] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:05:06 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 05 15:05:06.988071 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 412/815] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:05:06.992858 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-682db42b-a6bc-422f-8347-bbc66011bf9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:06.993602 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-682db42b-a6bc-422f-8347-bbc66011bf9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:06.999606 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-682db42b-a6bc-422f-8347-bbc66011bf9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:07.000046 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-682db42b-a6bc-422f-8347-bbc66011bf9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:07.003168 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-682db42b-a6bc-422f-8347-bbc66011bf9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:07.003168 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-682db42b-a6bc-422f-8347-bbc66011bf9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:07.419248 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-682db42b-a6bc-422f-8347-bbc66011bf9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:07.436548 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-682db42b-a6bc-422f-8347-bbc66011bf9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:07.438470 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-682db42b-a6bc-422f-8347-bbc66011bf9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:07.439653 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-682db42b-a6bc-422f-8347-bbc66011bf9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1724 microversion: 2.20 time: 0.450816 Jan 05 15:05:07.450534 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 413/816] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:06 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1724 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:07.985125 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-be9b723c-ea3c-4dc2-a2f7-7bdc2a1f7863 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:07.985685 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-be9b723c-ea3c-4dc2-a2f7-7bdc2a1f7863 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:07.992320 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-be9b723c-ea3c-4dc2-a2f7-7bdc2a1f7863 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:07.992776 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-be9b723c-ea3c-4dc2-a2f7-7bdc2a1f7863 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:07.993582 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-be9b723c-ea3c-4dc2-a2f7-7bdc2a1f7863 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:07.994195 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-be9b723c-ea3c-4dc2-a2f7-7bdc2a1f7863 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:08.048759 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-bbe39e4d-b164-4549-ba23-b68075585afe req-4bad9773-62c1-400c-9c4d-badefd62d979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:08.050547 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:05:08.050547 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:05:08.057942 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bbe39e4d-b164-4549-ba23-b68075585afe req-4bad9773-62c1-400c-9c4d-badefd62d979 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:08.058386 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bbe39e4d-b164-4549-ba23-b68075585afe req-4bad9773-62c1-400c-9c4d-badefd62d979 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:08.071196 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-bbe39e4d-b164-4549-ba23-b68075585afe req-4bad9773-62c1-400c-9c4d-badefd62d979 service nova] Creating event network-changed:4bda96b8-bc6e-4586-8d4d-5a66846e4b96 for instance 22497ce1-6400-4f16-a962-dce627a97693 on hv-cinder-maste Jan 05 15:05:08.076771 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-bbe39e4d-b164-4549-ba23-b68075585afe req-4bad9773-62c1-400c-9c4d-badefd62d979 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099648 Jan 05 15:05:08.076984 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-be9b723c-ea3c-4dc2-a2f7-7bdc2a1f7863 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lazy-loading 'services' on Instance uuid 22497ce1-6400-4f16-a962-dce627a97693 {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:05:08.077984 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 414/817] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:05:08.336824 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-be9b723c-ea3c-4dc2-a2f7-7bdc2a1f7863 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/os-volume_attachments/5c358bb0-90c9-47f0-9870-959445df1a99" status: 202 len: 0 microversion: 2.1 time: 0.362550 Jan 05 15:05:08.337453 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 404/818] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Jan 5 15:05:07 2022] DELETE /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/os-volume_attachments/5c358bb0-90c9-47f0-9870-959445df1a99 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:05:08.347203 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6753359c-9ca9-42aa-919f-0f5be8a5bfa1 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:08.349355 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6753359c-9ca9-42aa-919f-0f5be8a5bfa1 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:08.356267 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6753359c-9ca9-42aa-919f-0f5be8a5bfa1 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:08.356650 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6753359c-9ca9-42aa-919f-0f5be8a5bfa1 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:08.357491 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6753359c-9ca9-42aa-919f-0f5be8a5bfa1 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:08.357928 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6753359c-9ca9-42aa-919f-0f5be8a5bfa1 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:08.388723 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6753359c-9ca9-42aa-919f-0f5be8a5bfa1 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046563 Jan 05 15:05:08.389409 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 415/819] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:05:08 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:05:08.460357 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f79b541f-6d62-4473-a1fc-f4de4f52d1bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:08.465609 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f79b541f-6d62-4473-a1fc-f4de4f52d1bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:08.468600 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f79b541f-6d62-4473-a1fc-f4de4f52d1bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:08.469280 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f79b541f-6d62-4473-a1fc-f4de4f52d1bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:08.470150 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f79b541f-6d62-4473-a1fc-f4de4f52d1bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:08.470674 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f79b541f-6d62-4473-a1fc-f4de4f52d1bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:08.628368 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f79b541f-6d62-4473-a1fc-f4de4f52d1bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:08.639717 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f79b541f-6d62-4473-a1fc-f4de4f52d1bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:08.649055 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f79b541f-6d62-4473-a1fc-f4de4f52d1bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:08.650563 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f79b541f-6d62-4473-a1fc-f4de4f52d1bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1724 microversion: 2.20 time: 0.195993 Jan 05 15:05:08.652441 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 405/820] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:08 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:09.401484 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6c3f2a19-4336-46d7-89dd-e0fb0a6ab713 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:09.402459 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6c3f2a19-4336-46d7-89dd-e0fb0a6ab713 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:09.408738 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c3f2a19-4336-46d7-89dd-e0fb0a6ab713 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:09.409207 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c3f2a19-4336-46d7-89dd-e0fb0a6ab713 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:09.409981 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c3f2a19-4336-46d7-89dd-e0fb0a6ab713 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:09.410409 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c3f2a19-4336-46d7-89dd-e0fb0a6ab713 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:09.439548 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6c3f2a19-4336-46d7-89dd-e0fb0a6ab713 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043479 Jan 05 15:05:09.440090 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 416/821] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:05:09 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:05:09.669665 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1edecd96-1de1-4055-8b1e-212e4bda9dee tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:09.670196 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1edecd96-1de1-4055-8b1e-212e4bda9dee tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:09.676358 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1edecd96-1de1-4055-8b1e-212e4bda9dee tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:09.676800 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1edecd96-1de1-4055-8b1e-212e4bda9dee tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:09.677640 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1edecd96-1de1-4055-8b1e-212e4bda9dee tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:09.678106 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1edecd96-1de1-4055-8b1e-212e4bda9dee tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:09.809209 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-1edecd96-1de1-4055-8b1e-212e4bda9dee tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:09.816913 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-1edecd96-1de1-4055-8b1e-212e4bda9dee tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:09.818457 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-1edecd96-1de1-4055-8b1e-212e4bda9dee tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:09.819607 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1edecd96-1de1-4055-8b1e-212e4bda9dee tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1724 microversion: 2.20 time: 0.153752 Jan 05 15:05:09.820177 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 406/822] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:09 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:10.451107 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c0830f93-4d20-4961-83ec-2effb0086afa tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:10.452064 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c0830f93-4d20-4961-83ec-2effb0086afa tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:10.458233 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0830f93-4d20-4961-83ec-2effb0086afa tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:10.458682 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0830f93-4d20-4961-83ec-2effb0086afa tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:10.460096 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0830f93-4d20-4961-83ec-2effb0086afa tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:10.460541 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0830f93-4d20-4961-83ec-2effb0086afa tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:10.488259 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c0830f93-4d20-4961-83ec-2effb0086afa tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040918 Jan 05 15:05:10.488867 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 417/823] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:05:10 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:05:10.838287 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-25b3931e-0127-4223-87f8-02d018cdbaa9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:10.838886 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-25b3931e-0127-4223-87f8-02d018cdbaa9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:10.845166 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-25b3931e-0127-4223-87f8-02d018cdbaa9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:10.845618 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-25b3931e-0127-4223-87f8-02d018cdbaa9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:10.846387 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-25b3931e-0127-4223-87f8-02d018cdbaa9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:10.846820 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-25b3931e-0127-4223-87f8-02d018cdbaa9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:10.973265 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-25b3931e-0127-4223-87f8-02d018cdbaa9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:10.981864 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-25b3931e-0127-4223-87f8-02d018cdbaa9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:10.983508 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-25b3931e-0127-4223-87f8-02d018cdbaa9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:10.984597 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-25b3931e-0127-4223-87f8-02d018cdbaa9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1724 microversion: 2.20 time: 0.150748 Jan 05 15:05:10.985173 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 407/824] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:10 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:11.499584 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0deed242-29eb-4513-8af8-fdade089196c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:11.500496 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0deed242-29eb-4513-8af8-fdade089196c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:11.507384 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0deed242-29eb-4513-8af8-fdade089196c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:11.511513 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0deed242-29eb-4513-8af8-fdade089196c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:11.511513 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0deed242-29eb-4513-8af8-fdade089196c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:11.511513 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0deed242-29eb-4513-8af8-fdade089196c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:11.537952 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0deed242-29eb-4513-8af8-fdade089196c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042061 Jan 05 15:05:11.538509 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 418/825] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:05:11 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:05:11.879865 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1fb3f1ab-213c-4a9a-ad92-7d69a7806b7d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:11.880836 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1fb3f1ab-213c-4a9a-ad92-7d69a7806b7d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:11.887704 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1fb3f1ab-213c-4a9a-ad92-7d69a7806b7d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:11.888152 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1fb3f1ab-213c-4a9a-ad92-7d69a7806b7d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:11.894026 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1fb3f1ab-213c-4a9a-ad92-7d69a7806b7d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:11.894026 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1fb3f1ab-213c-4a9a-ad92-7d69a7806b7d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:11.918893 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1fb3f1ab-213c-4a9a-ad92-7d69a7806b7d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042769 Jan 05 15:05:11.919448 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 408/826] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:05:11 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:05:11.929678 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-47b99fe0-b369-4724-8a0d-055e7cc8aa68 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:11.930178 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-47b99fe0-b369-4724-8a0d-055e7cc8aa68 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:11.935896 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47b99fe0-b369-4724-8a0d-055e7cc8aa68 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:11.936346 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47b99fe0-b369-4724-8a0d-055e7cc8aa68 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:11.937156 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47b99fe0-b369-4724-8a0d-055e7cc8aa68 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:11.937601 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47b99fe0-b369-4724-8a0d-055e7cc8aa68 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:11.966114 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-47b99fe0-b369-4724-8a0d-055e7cc8aa68 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments/9c409c2e-1459-485d-9878-749de6bc3e4e" status: 200 len: 194 microversion: 2.1 time: 0.040838 Jan 05 15:05:11.966716 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 419/827] 10.222.0.30 () {58 vars in 1412 bytes} [Wed Jan 5 15:05:11 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments/9c409c2e-1459-485d-9878-749de6bc3e4e => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:05:12.002770 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c8a4086e-8a72-4880-9bbf-ace7cffde2e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:12.003373 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c8a4086e-8a72-4880-9bbf-ace7cffde2e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:12.009449 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c8a4086e-8a72-4880-9bbf-ace7cffde2e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:12.009893 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c8a4086e-8a72-4880-9bbf-ace7cffde2e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:12.010683 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c8a4086e-8a72-4880-9bbf-ace7cffde2e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:12.011083 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c8a4086e-8a72-4880-9bbf-ace7cffde2e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:12.145704 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c8a4086e-8a72-4880-9bbf-ace7cffde2e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:12.146602 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c8a4086e-8a72-4880-9bbf-ace7cffde2e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:12.148151 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c8a4086e-8a72-4880-9bbf-ace7cffde2e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:12.149311 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c8a4086e-8a72-4880-9bbf-ace7cffde2e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1724 microversion: 2.20 time: 0.150339 Jan 05 15:05:12.149873 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 409/828] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:11 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:12.549425 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-66b88a84-b6e2-4810-98aa-6d1176c50c97 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:12.550329 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-66b88a84-b6e2-4810-98aa-6d1176c50c97 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:12.556967 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66b88a84-b6e2-4810-98aa-6d1176c50c97 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:12.557594 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66b88a84-b6e2-4810-98aa-6d1176c50c97 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:12.558378 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66b88a84-b6e2-4810-98aa-6d1176c50c97 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:12.558822 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66b88a84-b6e2-4810-98aa-6d1176c50c97 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:12.588103 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-66b88a84-b6e2-4810-98aa-6d1176c50c97 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042584 Jan 05 15:05:12.588663 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 420/829] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:05:12 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:05:12.598405 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-23858d2e-ea3d-4250-a5c7-190cfa6589f4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:12.598896 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-23858d2e-ea3d-4250-a5c7-190cfa6589f4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:12.605653 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-23858d2e-ea3d-4250-a5c7-190cfa6589f4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:12.606274 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-23858d2e-ea3d-4250-a5c7-190cfa6589f4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:12.606911 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-23858d2e-ea3d-4250-a5c7-190cfa6589f4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:12.607348 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-23858d2e-ea3d-4250-a5c7-190cfa6589f4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:12.677887 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-23858d2e-ea3d-4250-a5c7-190cfa6589f4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] HTTP exception thrown: Instance 22497ce1-6400-4f16-a962-dce627a97693 is not attached to volume 5c358bb0-90c9-47f0-9870-959445df1a99 Jan 05 15:05:12.678508 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-23858d2e-ea3d-4250-a5c7-190cfa6589f4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Returning 404 to user: Instance 22497ce1-6400-4f16-a962-dce627a97693 is not attached to volume 5c358bb0-90c9-47f0-9870-959445df1a99 {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:05:12.679343 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-23858d2e-ea3d-4250-a5c7-190cfa6589f4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/os-volume_attachments/5c358bb0-90c9-47f0-9870-959445df1a99" status: 404 len: 154 microversion: 2.1 time: 0.085030 Jan 05 15:05:12.679893 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 410/830] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Jan 5 15:05:12 2022] DELETE /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693/os-volume_attachments/5c358bb0-90c9-47f0-9870-959445df1a99 => generated 154 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:05:13.167034 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1e74c675-29ef-496f-98e0-008f36bdb2c6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:13.167579 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1e74c675-29ef-496f-98e0-008f36bdb2c6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:13.173385 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e74c675-29ef-496f-98e0-008f36bdb2c6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:13.173855 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e74c675-29ef-496f-98e0-008f36bdb2c6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:13.174623 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e74c675-29ef-496f-98e0-008f36bdb2c6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:13.175046 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e74c675-29ef-496f-98e0-008f36bdb2c6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:13.306881 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e74c675-29ef-496f-98e0-008f36bdb2c6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:13.314553 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e74c675-29ef-496f-98e0-008f36bdb2c6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:13.316057 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e74c675-29ef-496f-98e0-008f36bdb2c6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:13.317228 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1e74c675-29ef-496f-98e0-008f36bdb2c6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1724 microversion: 2.20 time: 0.154013 Jan 05 15:05:13.317775 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 421/831] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:13 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:13.562176 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-cf72712e-59d8-4cd7-8a03-8d66104b26af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6a5ee54-3c8e-4ba2-a8de-d50c877744dd"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:13.563335 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-cf72712e-59d8-4cd7-8a03-8d66104b26af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:13.570032 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cf72712e-59d8-4cd7-8a03-8d66104b26af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:13.570484 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cf72712e-59d8-4cd7-8a03-8d66104b26af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:13.571297 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cf72712e-59d8-4cd7-8a03-8d66104b26af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:13.571725 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cf72712e-59d8-4cd7-8a03-8d66104b26af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:13.949448 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:13.949971 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:13.956240 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:13.956691 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:13.957482 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:13.957911 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:13.982736 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:05:14.330990 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 204 len: 0 microversion: 2.1 time: 0.384819 Jan 05 15:05:14.331706 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 422/832] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:05:13 2022] DELETE /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 05 15:05:14.337554 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-57cfe6f9-2c34-420f-8c32-661c07df426c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:14.338237 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-57cfe6f9-2c34-420f-8c32-661c07df426c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:14.343892 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57cfe6f9-2c34-420f-8c32-661c07df426c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:14.344333 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57cfe6f9-2c34-420f-8c32-661c07df426c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:14.345133 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57cfe6f9-2c34-420f-8c32-661c07df426c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:14.345560 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57cfe6f9-2c34-420f-8c32-661c07df426c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:14.363431 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-cf72712e-59d8-4cd7-8a03-8d66104b26af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.804806 Jan 05 15:05:14.364147 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 411/833] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Jan 5 15:05:13 2022] POST /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments => generated 194 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:05:14.369291 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-fc6e57b7-ba76-4ddb-95db-430f744732e7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:14.369982 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-fc6e57b7-ba76-4ddb-95db-430f744732e7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:14.376117 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fc6e57b7-ba76-4ddb-95db-430f744732e7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:14.376553 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fc6e57b7-ba76-4ddb-95db-430f744732e7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:14.377388 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fc6e57b7-ba76-4ddb-95db-430f744732e7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:14.377878 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fc6e57b7-ba76-4ddb-95db-430f744732e7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:14.490341 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-57cfe6f9-2c34-420f-8c32-661c07df426c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:14.500903 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-57cfe6f9-2c34-420f-8c32-661c07df426c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:14.502697 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-57cfe6f9-2c34-420f-8c32-661c07df426c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:14.504085 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-57cfe6f9-2c34-420f-8c32-661c07df426c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1724 microversion: 2.20 time: 0.171257 Jan 05 15:05:14.505095 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 423/834] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:14 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:14.527611 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-fc6e57b7-ba76-4ddb-95db-430f744732e7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:14.535246 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-fc6e57b7-ba76-4ddb-95db-430f744732e7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1555 microversion: 2.1 time: 0.169990 Jan 05 15:05:14.535795 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 412/835] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:14 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:05:15.522564 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5f7fa794-ed1a-476e-a49a-65b5d0784836 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:15.523260 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5f7fa794-ed1a-476e-a49a-65b5d0784836 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:15.529552 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f7fa794-ed1a-476e-a49a-65b5d0784836 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:15.530011 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f7fa794-ed1a-476e-a49a-65b5d0784836 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:15.530790 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f7fa794-ed1a-476e-a49a-65b5d0784836 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:15.531226 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f7fa794-ed1a-476e-a49a-65b5d0784836 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:15.552039 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-4874c7a3-3d40-42ac-8530-6f16a6d479ac tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:15.552647 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-4874c7a3-3d40-42ac-8530-6f16a6d479ac tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:15.559326 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4874c7a3-3d40-42ac-8530-6f16a6d479ac tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:15.559782 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4874c7a3-3d40-42ac-8530-6f16a6d479ac tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:15.560559 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4874c7a3-3d40-42ac-8530-6f16a6d479ac tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:15.560995 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4874c7a3-3d40-42ac-8530-6f16a6d479ac tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:15.665669 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-5f7fa794-ed1a-476e-a49a-65b5d0784836 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:15.673259 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-5f7fa794-ed1a-476e-a49a-65b5d0784836 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:15.674756 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-5f7fa794-ed1a-476e-a49a-65b5d0784836 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:15.675892 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5f7fa794-ed1a-476e-a49a-65b5d0784836 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1724 microversion: 2.20 time: 0.157086 Jan 05 15:05:15.676444 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 424/836] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:15 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:15.689974 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-4874c7a3-3d40-42ac-8530-6f16a6d479ac tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:15.697365 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-4874c7a3-3d40-42ac-8530-6f16a6d479ac tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1555 microversion: 2.1 time: 0.148988 Jan 05 15:05:15.697926 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 413/837] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:15 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:05:16.694573 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7c446176-104e-4fc7-9c09-3adfb7c22563 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:16.696293 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7c446176-104e-4fc7-9c09-3adfb7c22563 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:16.702803 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c446176-104e-4fc7-9c09-3adfb7c22563 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:16.703236 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c446176-104e-4fc7-9c09-3adfb7c22563 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:16.704020 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c446176-104e-4fc7-9c09-3adfb7c22563 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:16.704530 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c446176-104e-4fc7-9c09-3adfb7c22563 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:16.717941 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a1ad977c-7260-42c9-8d4b-7f53bc471777 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:16.717941 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a1ad977c-7260-42c9-8d4b-7f53bc471777 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:16.724957 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a1ad977c-7260-42c9-8d4b-7f53bc471777 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:16.725570 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a1ad977c-7260-42c9-8d4b-7f53bc471777 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:16.727587 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a1ad977c-7260-42c9-8d4b-7f53bc471777 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:16.728516 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a1ad977c-7260-42c9-8d4b-7f53bc471777 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:16.790334 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a1ad977c-7260-42c9-8d4b-7f53bc471777 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036ba058101541b891732f6d9591c876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:16.797660 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a1ad977c-7260-42c9-8d4b-7f53bc471777 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 200 len: 1513 microversion: 2.1 time: 0.085202 Jan 05 15:05:16.798243 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 414/838] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:16 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 1513 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:05:16.802542 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-ac423a00-1a2a-4b31-8c41-3cfc03642b6f req-c99fff33-d52d-440c-9238-202c2d591f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "name": "network-vif-deleted", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:16.804100 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:05:16.804100 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:05:16.811328 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-ac423a00-1a2a-4b31-8c41-3cfc03642b6f req-c99fff33-d52d-440c-9238-202c2d591f53 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:16.814886 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-ac423a00-1a2a-4b31-8c41-3cfc03642b6f req-c99fff33-d52d-440c-9238-202c2d591f53 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:16.823516 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-ac423a00-1a2a-4b31-8c41-3cfc03642b6f req-c99fff33-d52d-440c-9238-202c2d591f53 service nova] Creating event network-vif-deleted:4bda96b8-bc6e-4586-8d4d-5a66846e4b96 for instance 22497ce1-6400-4f16-a962-dce627a97693 on hv-cinder-maste Jan 05 15:05:16.828702 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-ac423a00-1a2a-4b31-8c41-3cfc03642b6f req-c99fff33-d52d-440c-9238-202c2d591f53 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029337 Jan 05 15:05:16.829407 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 415/839] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:05:16.860374 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-7c446176-104e-4fc7-9c09-3adfb7c22563 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:16.869330 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-7c446176-104e-4fc7-9c09-3adfb7c22563 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:16.870848 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-7c446176-104e-4fc7-9c09-3adfb7c22563 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:16.872058 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7c446176-104e-4fc7-9c09-3adfb7c22563 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1724 microversion: 2.20 time: 0.181283 Jan 05 15:05:16.872625 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 425/840] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:16 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:17.816002 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-abd23d53-9bdb-4605-98e6-a231565b3b4c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:17.816617 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-abd23d53-9bdb-4605-98e6-a231565b3b4c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] [instance: 22497ce1-6400-4f16-a962-dce627a97693] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:17.824256 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-abd23d53-9bdb-4605-98e6-a231565b3b4c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:17.824707 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-abd23d53-9bdb-4605-98e6-a231565b3b4c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:17.825521 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-abd23d53-9bdb-4605-98e6-a231565b3b4c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:17.825955 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-abd23d53-9bdb-4605-98e6-a231565b3b4c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:17.842461 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-abd23d53-9bdb-4605-98e6-a231565b3b4c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] HTTP exception thrown: Instance 22497ce1-6400-4f16-a962-dce627a97693 could not be found. Jan 05 15:05:17.843062 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-abd23d53-9bdb-4605-98e6-a231565b3b4c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Returning 404 to user: Instance 22497ce1-6400-4f16-a962-dce627a97693 could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:05:17.843865 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-abd23d53-9bdb-4605-98e6-a231565b3b4c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693" status: 404 len: 111 microversion: 2.1 time: 0.032767 Jan 05 15:05:17.844418 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 416/841] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:17 2022] GET /compute/v2.1/servers/22497ce1-6400-4f16-a962-dce627a97693 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:05:17.853440 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-140fb492-5650-42c2-9794-9990d000f5f4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling method '.version_select at 0x7f2172fd0b80>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:17.890718 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-9c93ef31-38dd-4114-8eca-2401c1b8d47e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:17.891320 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-9c93ef31-38dd-4114-8eca-2401c1b8d47e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:17.897197 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9c93ef31-38dd-4114-8eca-2401c1b8d47e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:17.897641 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9c93ef31-38dd-4114-8eca-2401c1b8d47e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:17.899064 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9c93ef31-38dd-4114-8eca-2401c1b8d47e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:17.899499 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9c93ef31-38dd-4114-8eca-2401c1b8d47e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:17.931990 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-140fb492-5650-42c2-9794-9990d000f5f4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1383600894" status: 202 len: 0 microversion: 2.1 time: 0.083024 Jan 05 15:05:17.932572 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 426/842] 10.222.0.30 () {58 vars in 1271 bytes} [Wed Jan 5 15:05:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1383600894 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:05:18.035078 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-9c93ef31-38dd-4114-8eca-2401c1b8d47e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:18.042925 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-9c93ef31-38dd-4114-8eca-2401c1b8d47e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:18.044428 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-9c93ef31-38dd-4114-8eca-2401c1b8d47e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:18.045603 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-9c93ef31-38dd-4114-8eca-2401c1b8d47e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1724 microversion: 2.20 time: 0.158566 Jan 05 15:05:18.046150 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 417/843] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:17 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:05:19.064195 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6c215518-5cc2-441f-bfc3-28ad88102f35 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:19.064845 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6c215518-5cc2-441f-bfc3-28ad88102f35 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:19.071510 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c215518-5cc2-441f-bfc3-28ad88102f35 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:19.071956 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c215518-5cc2-441f-bfc3-28ad88102f35 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:19.072757 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c215518-5cc2-441f-bfc3-28ad88102f35 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:19.073204 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c215518-5cc2-441f-bfc3-28ad88102f35 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:19.205987 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6c215518-5cc2-441f-bfc3-28ad88102f35 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:19.213668 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6c215518-5cc2-441f-bfc3-28ad88102f35 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:19.215165 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6c215518-5cc2-441f-bfc3-28ad88102f35 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:19.216313 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6c215518-5cc2-441f-bfc3-28ad88102f35 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1724 microversion: 2.20 time: 0.156503 Jan 05 15:05:19.216854 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 427/844] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:19 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:20.235545 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ddcfea41-2d6d-4f18-b2a9-7c0c1d61a989 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:20.236306 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ddcfea41-2d6d-4f18-b2a9-7c0c1d61a989 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:20.243857 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ddcfea41-2d6d-4f18-b2a9-7c0c1d61a989 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:20.244307 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ddcfea41-2d6d-4f18-b2a9-7c0c1d61a989 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:20.245175 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ddcfea41-2d6d-4f18-b2a9-7c0c1d61a989 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:20.245608 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ddcfea41-2d6d-4f18-b2a9-7c0c1d61a989 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:20.727002 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ddcfea41-2d6d-4f18-b2a9-7c0c1d61a989 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:20.735165 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ddcfea41-2d6d-4f18-b2a9-7c0c1d61a989 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:20.736758 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ddcfea41-2d6d-4f18-b2a9-7c0c1d61a989 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:20.738007 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ddcfea41-2d6d-4f18-b2a9-7c0c1d61a989 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1724 microversion: 2.20 time: 0.506749 Jan 05 15:05:20.738564 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 418/845] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:20 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1724 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:21.755478 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d4f7db70-729c-4f2a-8c0d-ee5910ab31bf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:21.756088 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d4f7db70-729c-4f2a-8c0d-ee5910ab31bf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:21.763248 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4f7db70-729c-4f2a-8c0d-ee5910ab31bf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:21.763693 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4f7db70-729c-4f2a-8c0d-ee5910ab31bf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:21.764671 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4f7db70-729c-4f2a-8c0d-ee5910ab31bf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:21.765296 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4f7db70-729c-4f2a-8c0d-ee5910ab31bf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:21.928844 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d4f7db70-729c-4f2a-8c0d-ee5910ab31bf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:21.938536 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d4f7db70-729c-4f2a-8c0d-ee5910ab31bf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:21.940348 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d4f7db70-729c-4f2a-8c0d-ee5910ab31bf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:21.941682 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d4f7db70-729c-4f2a-8c0d-ee5910ab31bf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1724 microversion: 2.20 time: 0.189860 Jan 05 15:05:21.942351 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 428/846] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:21 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:22.906625 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-20c6c897-8100-4ea0-b644-d6c72db4f6f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:22.907596 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-20c6c897-8100-4ea0-b644-d6c72db4f6f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:22.913904 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-20c6c897-8100-4ea0-b644-d6c72db4f6f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:22.914352 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-20c6c897-8100-4ea0-b644-d6c72db4f6f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:22.915141 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-20c6c897-8100-4ea0-b644-d6c72db4f6f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:22.915577 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-20c6c897-8100-4ea0-b644-d6c72db4f6f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:22.946558 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-20c6c897-8100-4ea0-b644-d6c72db4f6f2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043639 Jan 05 15:05:22.947133 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 419/847] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:05:22 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:05:22.969313 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eef3763b-c5c4-4644-bcef-3bb3bf5173da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:22.970743 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eef3763b-c5c4-4644-bcef-3bb3bf5173da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:22.977709 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eef3763b-c5c4-4644-bcef-3bb3bf5173da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:22.978435 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eef3763b-c5c4-4644-bcef-3bb3bf5173da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:22.979231 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eef3763b-c5c4-4644-bcef-3bb3bf5173da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:22.979657 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eef3763b-c5c4-4644-bcef-3bb3bf5173da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:23.117828 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-eef3763b-c5c4-4644-bcef-3bb3bf5173da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:23.125938 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-eef3763b-c5c4-4644-bcef-3bb3bf5173da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:23.127457 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-eef3763b-c5c4-4644-bcef-3bb3bf5173da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:23.128639 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eef3763b-c5c4-4644-bcef-3bb3bf5173da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1745 microversion: 2.20 time: 0.166292 Jan 05 15:05:23.129222 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 429/848] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:22 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:23.257646 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-152b98f3-ed6d-4cc7-a092-ab29663ea3bb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:23.258334 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-152b98f3-ed6d-4cc7-a092-ab29663ea3bb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:23.264103 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-152b98f3-ed6d-4cc7-a092-ab29663ea3bb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:23.264651 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-152b98f3-ed6d-4cc7-a092-ab29663ea3bb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:23.265579 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-152b98f3-ed6d-4cc7-a092-ab29663ea3bb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:23.266087 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-152b98f3-ed6d-4cc7-a092-ab29663ea3bb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:23.294828 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-152b98f3-ed6d-4cc7-a092-ab29663ea3bb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments/9c409c2e-1459-485d-9878-749de6bc3e4e" status: 200 len: 194 microversion: 2.1 time: 0.041404 Jan 05 15:05:23.295354 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 420/849] 10.222.0.30 () {58 vars in 1412 bytes} [Wed Jan 5 15:05:23 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments/9c409c2e-1459-485d-9878-749de6bc3e4e => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:05:23.304790 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4e5b10f1-7117-4537-86e8-4d7a0a9f582d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:23.305314 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4e5b10f1-7117-4537-86e8-4d7a0a9f582d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:23.311195 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e5b10f1-7117-4537-86e8-4d7a0a9f582d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:23.311644 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e5b10f1-7117-4537-86e8-4d7a0a9f582d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:23.312419 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e5b10f1-7117-4537-86e8-4d7a0a9f582d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:23.312850 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e5b10f1-7117-4537-86e8-4d7a0a9f582d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:23.389595 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-4e5b10f1-7117-4537-86e8-4d7a0a9f582d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lazy-loading 'services' on Instance uuid 62d39a5b-dac1-4667-b829-53506cf0c62b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:05:23.593319 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4e5b10f1-7117-4537-86e8-4d7a0a9f582d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "DELETE /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments/9c409c2e-1459-485d-9878-749de6bc3e4e" status: 202 len: 0 microversion: 2.1 time: 0.292022 Jan 05 15:05:23.593983 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 430/850] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Jan 5 15:05:23 2022] DELETE /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments/9c409c2e-1459-485d-9878-749de6bc3e4e => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:05:24.151937 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-af5d1a53-8263-4f87-ae45-06ecae5313b3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:24.152497 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-af5d1a53-8263-4f87-ae45-06ecae5313b3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:24.158304 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-af5d1a53-8263-4f87-ae45-06ecae5313b3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:24.158749 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-af5d1a53-8263-4f87-ae45-06ecae5313b3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:24.159521 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-af5d1a53-8263-4f87-ae45-06ecae5313b3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:24.159951 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-af5d1a53-8263-4f87-ae45-06ecae5313b3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:24.290808 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-af5d1a53-8263-4f87-ae45-06ecae5313b3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:24.298690 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-af5d1a53-8263-4f87-ae45-06ecae5313b3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:24.300181 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-af5d1a53-8263-4f87-ae45-06ecae5313b3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:24.301384 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-af5d1a53-8263-4f87-ae45-06ecae5313b3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1745 microversion: 2.20 time: 0.154003 Jan 05 15:05:24.309003 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 421/851] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:24 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:25.322309 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-51daea24-71cf-456e-a074-fa9fe8b2a942 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:25.323015 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-51daea24-71cf-456e-a074-fa9fe8b2a942 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:25.329837 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51daea24-71cf-456e-a074-fa9fe8b2a942 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:25.330707 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51daea24-71cf-456e-a074-fa9fe8b2a942 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:25.331408 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51daea24-71cf-456e-a074-fa9fe8b2a942 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:25.331845 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51daea24-71cf-456e-a074-fa9fe8b2a942 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:25.546099 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-51daea24-71cf-456e-a074-fa9fe8b2a942 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:25.555798 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-51daea24-71cf-456e-a074-fa9fe8b2a942 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:25.558348 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-51daea24-71cf-456e-a074-fa9fe8b2a942 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:25.559673 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-51daea24-71cf-456e-a074-fa9fe8b2a942 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1740 microversion: 2.20 time: 0.243469 Jan 05 15:05:25.560322 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 431/852] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:25 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:25.756500 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e53f7b5b-cfc0-41e7-bf72-05de0d0770a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:25.757149 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e53f7b5b-cfc0-41e7-bf72-05de0d0770a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:25.764322 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e53f7b5b-cfc0-41e7-bf72-05de0d0770a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:25.764769 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e53f7b5b-cfc0-41e7-bf72-05de0d0770a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:25.765570 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e53f7b5b-cfc0-41e7-bf72-05de0d0770a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:25.766145 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e53f7b5b-cfc0-41e7-bf72-05de0d0770a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:25.795074 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e53f7b5b-cfc0-41e7-bf72-05de0d0770a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments/c6a5ee54-3c8e-4ba2-a8de-d50c877744dd" status: 200 len: 194 microversion: 2.1 time: 0.042135 Jan 05 15:05:25.795584 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 422/853] 10.222.0.30 () {58 vars in 1412 bytes} [Wed Jan 5 15:05:25 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments/c6a5ee54-3c8e-4ba2-a8de-d50c877744dd => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:05:25.805771 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cb7a9da0-775e-4610-b6c7-52e745aacbe5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:25.806197 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cb7a9da0-775e-4610-b6c7-52e745aacbe5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:25.812891 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb7a9da0-775e-4610-b6c7-52e745aacbe5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:25.813439 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb7a9da0-775e-4610-b6c7-52e745aacbe5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:25.814378 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb7a9da0-775e-4610-b6c7-52e745aacbe5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:25.814747 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb7a9da0-775e-4610-b6c7-52e745aacbe5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:25.897895 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-cb7a9da0-775e-4610-b6c7-52e745aacbe5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lazy-loading 'services' on Instance uuid 62d39a5b-dac1-4667-b829-53506cf0c62b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:05:26.316485 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cb7a9da0-775e-4610-b6c7-52e745aacbe5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "DELETE /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments/c6a5ee54-3c8e-4ba2-a8de-d50c877744dd" status: 202 len: 0 microversion: 2.1 time: 0.515010 Jan 05 15:05:26.317725 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 432/854] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Jan 5 15:05:25 2022] DELETE /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments/c6a5ee54-3c8e-4ba2-a8de-d50c877744dd => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:05:26.579615 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ded3c757-b2ed-49ad-a90e-7c3488cc64af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:26.580237 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ded3c757-b2ed-49ad-a90e-7c3488cc64af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:26.587104 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ded3c757-b2ed-49ad-a90e-7c3488cc64af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:26.587557 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ded3c757-b2ed-49ad-a90e-7c3488cc64af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:26.588480 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ded3c757-b2ed-49ad-a90e-7c3488cc64af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:26.588921 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ded3c757-b2ed-49ad-a90e-7c3488cc64af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:26.805728 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ded3c757-b2ed-49ad-a90e-7c3488cc64af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:26.814902 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ded3c757-b2ed-49ad-a90e-7c3488cc64af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:26.816661 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ded3c757-b2ed-49ad-a90e-7c3488cc64af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:26.818519 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ded3c757-b2ed-49ad-a90e-7c3488cc64af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1740 microversion: 2.20 time: 0.243250 Jan 05 15:05:26.830520 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 423/855] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:26 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:27.837923 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-18c592ed-e6af-41e5-8579-a6cf5b0150cf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:27.838757 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-18c592ed-e6af-41e5-8579-a6cf5b0150cf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:27.846073 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18c592ed-e6af-41e5-8579-a6cf5b0150cf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:27.846805 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18c592ed-e6af-41e5-8579-a6cf5b0150cf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:27.847590 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18c592ed-e6af-41e5-8579-a6cf5b0150cf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:27.848175 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18c592ed-e6af-41e5-8579-a6cf5b0150cf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:28.012022 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-18c592ed-e6af-41e5-8579-a6cf5b0150cf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:28.020757 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-18c592ed-e6af-41e5-8579-a6cf5b0150cf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:28.036508 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-18c592ed-e6af-41e5-8579-a6cf5b0150cf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:28.037790 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-18c592ed-e6af-41e5-8579-a6cf5b0150cf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1740 microversion: 2.20 time: 0.204073 Jan 05 15:05:28.044499 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 433/856] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:27 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:28.508692 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-fb64be98-49d6-48c7-9405-65f209ad6923 req-85109e1d-3e21-4ffd-8813-fa24b53a2320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "name": "network-vif-plugged", "status": "completed", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:28.513458 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:05:28.513458 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:05:28.524394 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-fb64be98-49d6-48c7-9405-65f209ad6923 req-85109e1d-3e21-4ffd-8813-fa24b53a2320 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:28.525087 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-fb64be98-49d6-48c7-9405-65f209ad6923 req-85109e1d-3e21-4ffd-8813-fa24b53a2320 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:28.539430 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-fb64be98-49d6-48c7-9405-65f209ad6923 req-85109e1d-3e21-4ffd-8813-fa24b53a2320 service nova] Creating event network-vif-plugged:0d57813b-5531-41c7-8d8d-8b2fc393b843 for instance a591f495-ff59-4865-87ea-c48041ea097f on hv-cinder-maste Jan 05 15:05:28.546070 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-fb64be98-49d6-48c7-9405-65f209ad6923 req-85109e1d-3e21-4ffd-8813-fa24b53a2320 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274881 Jan 05 15:05:28.547724 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 424/857] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:05:28.637389 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f2aee614-2258-43d8-92a3-43f055e79503 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:28.638641 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f2aee614-2258-43d8-92a3-43f055e79503 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:28.644635 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2aee614-2258-43d8-92a3-43f055e79503 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:28.645100 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2aee614-2258-43d8-92a3-43f055e79503 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:28.646202 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2aee614-2258-43d8-92a3-43f055e79503 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:28.646788 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2aee614-2258-43d8-92a3-43f055e79503 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:28.681940 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f2aee614-2258-43d8-92a3-43f055e79503 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048421 Jan 05 15:05:28.683106 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 434/858] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:05:28 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:05:28.806520 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-772dc3a9-4585-48ea-823a-a8e782169160 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:28.807655 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-772dc3a9-4585-48ea-823a-a8e782169160 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:28.814254 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-772dc3a9-4585-48ea-823a-a8e782169160 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:28.814774 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-772dc3a9-4585-48ea-823a-a8e782169160 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:28.815796 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-772dc3a9-4585-48ea-823a-a8e782169160 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:28.816428 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-772dc3a9-4585-48ea-823a-a8e782169160 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:28.853831 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-772dc3a9-4585-48ea-823a-a8e782169160 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051511 Jan 05 15:05:28.854715 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 425/859] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:05:28 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:05:28.918786 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:28.919842 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:28.926062 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:28.926691 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:28.927659 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:28.928263 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:28.954388 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:05:29.056635 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c37f366b-6dc4-4e16-9561-10671d093a89 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:29.057535 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c37f366b-6dc4-4e16-9561-10671d093a89 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:29.066427 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c37f366b-6dc4-4e16-9561-10671d093a89 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:29.067086 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c37f366b-6dc4-4e16-9561-10671d093a89 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:29.068083 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c37f366b-6dc4-4e16-9561-10671d093a89 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:29.068633 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c37f366b-6dc4-4e16-9561-10671d093a89 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:29.224696 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c37f366b-6dc4-4e16-9561-10671d093a89 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:29.233800 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c37f366b-6dc4-4e16-9561-10671d093a89 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:29.235136 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c37f366b-6dc4-4e16-9561-10671d093a89 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:29.237036 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c37f366b-6dc4-4e16-9561-10671d093a89 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1740 microversion: 2.20 time: 0.184275 Jan 05 15:05:29.249866 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 426/860] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:29 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:05:29.691166 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "DELETE /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 204 len: 0 microversion: 2.1 time: 0.775651 Jan 05 15:05:29.691762 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 435/861] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:05:28 2022] DELETE /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 0 bytes in 777 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:05:29.699698 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b7760560-b090-4cb0-bc65-33aac863e89c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:29.705861 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b7760560-b090-4cb0-bc65-33aac863e89c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:29.706617 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b7760560-b090-4cb0-bc65-33aac863e89c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:29.707064 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b7760560-b090-4cb0-bc65-33aac863e89c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:29.707835 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b7760560-b090-4cb0-bc65-33aac863e89c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:29.708269 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b7760560-b090-4cb0-bc65-33aac863e89c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:29.837421 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b7760560-b090-4cb0-bc65-33aac863e89c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:29.844870 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b7760560-b090-4cb0-bc65-33aac863e89c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1670 microversion: 2.1 time: 0.148893 Jan 05 15:05:29.845471 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 427/862] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:29 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1670 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:05:30.258328 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e48c3df1-2a55-48ea-b964-9797c37c0f48 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:30.258966 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e48c3df1-2a55-48ea-b964-9797c37c0f48 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:30.265996 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e48c3df1-2a55-48ea-b964-9797c37c0f48 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:30.266438 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e48c3df1-2a55-48ea-b964-9797c37c0f48 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:30.267607 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e48c3df1-2a55-48ea-b964-9797c37c0f48 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:30.268166 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e48c3df1-2a55-48ea-b964-9797c37c0f48 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:30.485898 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e48c3df1-2a55-48ea-b964-9797c37c0f48 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:30.505058 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e48c3df1-2a55-48ea-b964-9797c37c0f48 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:30.507783 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e48c3df1-2a55-48ea-b964-9797c37c0f48 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:30.509287 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e48c3df1-2a55-48ea-b964-9797c37c0f48 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1740 microversion: 2.20 time: 0.257699 Jan 05 15:05:30.521143 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 436/863] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:30 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1740 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:05:30.863396 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f19a04b5-f580-477a-bc62-2d63f77ea195 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:30.864715 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f19a04b5-f580-477a-bc62-2d63f77ea195 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:30.878152 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f19a04b5-f580-477a-bc62-2d63f77ea195 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:30.878882 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f19a04b5-f580-477a-bc62-2d63f77ea195 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:30.879927 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f19a04b5-f580-477a-bc62-2d63f77ea195 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:30.880546 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f19a04b5-f580-477a-bc62-2d63f77ea195 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:31.047066 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f19a04b5-f580-477a-bc62-2d63f77ea195 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:31.059324 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f19a04b5-f580-477a-bc62-2d63f77ea195 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1670 microversion: 2.1 time: 0.199698 Jan 05 15:05:31.060531 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 428/864] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:30 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1670 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:05:31.527744 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80fbbbb9-8b0a-412b-b7a5-fe59b0797ea0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:31.529326 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-80fbbbb9-8b0a-412b-b7a5-fe59b0797ea0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:31.536706 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80fbbbb9-8b0a-412b-b7a5-fe59b0797ea0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:31.537180 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80fbbbb9-8b0a-412b-b7a5-fe59b0797ea0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:31.537966 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80fbbbb9-8b0a-412b-b7a5-fe59b0797ea0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:31.539253 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80fbbbb9-8b0a-412b-b7a5-fe59b0797ea0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:31.724653 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-80fbbbb9-8b0a-412b-b7a5-fe59b0797ea0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:31.736365 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-80fbbbb9-8b0a-412b-b7a5-fe59b0797ea0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:31.738725 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-80fbbbb9-8b0a-412b-b7a5-fe59b0797ea0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:31.740182 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-80fbbbb9-8b0a-412b-b7a5-fe59b0797ea0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1740 microversion: 2.20 time: 0.216330 Jan 05 15:05:31.740988 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 437/865] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:31 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:32.076839 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2f1e40ce-47aa-4a74-be3c-243fa5024890 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:32.077524 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2f1e40ce-47aa-4a74-be3c-243fa5024890 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:32.092425 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2f1e40ce-47aa-4a74-be3c-243fa5024890 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:32.095747 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2f1e40ce-47aa-4a74-be3c-243fa5024890 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:32.095747 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2f1e40ce-47aa-4a74-be3c-243fa5024890 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:32.095747 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2f1e40ce-47aa-4a74-be3c-243fa5024890 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:32.290150 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-2f1e40ce-47aa-4a74-be3c-243fa5024890 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:32.297894 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2f1e40ce-47aa-4a74-be3c-243fa5024890 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1670 microversion: 2.1 time: 0.224849 Jan 05 15:05:32.298788 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 429/866] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:32 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1670 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:05:32.754536 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7ea2d4ff-f25a-44bd-b146-21e9a00d8dd4 req-94a91540-9bcf-44ea-a27a-adf090ebbe58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d39a5b-dac1-4667-b829-53506cf0c62b", "name": "network-vif-deleted", "tag": "370464b7-853e-4daf-92d9-8ffcbe014202"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:32.760610 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-81cdfe84-13a5-4c76-b0ca-477f34797dc5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:32.761448 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-81cdfe84-13a5-4c76-b0ca-477f34797dc5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:32.762038 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:05:32.762038 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:05:32.768390 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-81cdfe84-13a5-4c76-b0ca-477f34797dc5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:32.769288 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-81cdfe84-13a5-4c76-b0ca-477f34797dc5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:32.770425 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-81cdfe84-13a5-4c76-b0ca-477f34797dc5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:32.771024 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-81cdfe84-13a5-4c76-b0ca-477f34797dc5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:32.778128 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7ea2d4ff-f25a-44bd-b146-21e9a00d8dd4 req-94a91540-9bcf-44ea-a27a-adf090ebbe58 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:32.780472 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7ea2d4ff-f25a-44bd-b146-21e9a00d8dd4 req-94a91540-9bcf-44ea-a27a-adf090ebbe58 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:32.805180 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7ea2d4ff-f25a-44bd-b146-21e9a00d8dd4 req-94a91540-9bcf-44ea-a27a-adf090ebbe58 service nova] Creating event network-vif-deleted:370464b7-853e-4daf-92d9-8ffcbe014202 for instance 62d39a5b-dac1-4667-b829-53506cf0c62b on hv-cinder-maste Jan 05 15:05:32.811608 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7ea2d4ff-f25a-44bd-b146-21e9a00d8dd4 req-94a91540-9bcf-44ea-a27a-adf090ebbe58 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072490 Jan 05 15:05:32.812608 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 438/867] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:05:32.946922 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-81cdfe84-13a5-4c76-b0ca-477f34797dc5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:32.955746 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-81cdfe84-13a5-4c76-b0ca-477f34797dc5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:32.957506 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-81cdfe84-13a5-4c76-b0ca-477f34797dc5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:32.958839 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-81cdfe84-13a5-4c76-b0ca-477f34797dc5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1740 microversion: 2.20 time: 0.202755 Jan 05 15:05:32.961366 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 430/868] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:32 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:33.316384 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5d27bd71-e569-4341-a355-61e9c06dfcdb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:33.317120 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5d27bd71-e569-4341-a355-61e9c06dfcdb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:33.324585 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d27bd71-e569-4341-a355-61e9c06dfcdb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:33.325039 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d27bd71-e569-4341-a355-61e9c06dfcdb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:33.325847 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d27bd71-e569-4341-a355-61e9c06dfcdb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:33.326281 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d27bd71-e569-4341-a355-61e9c06dfcdb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:33.397483 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-5d27bd71-e569-4341-a355-61e9c06dfcdb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:33.405491 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5d27bd71-e569-4341-a355-61e9c06dfcdb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1604 microversion: 2.1 time: 0.093815 Jan 05 15:05:33.406304 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 439/869] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:33 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1604 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:05:33.982752 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3a514ad1-a7d1-4bb7-afed-e3f79b85eb40 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:33.985790 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3a514ad1-a7d1-4bb7-afed-e3f79b85eb40 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:33.995277 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3a514ad1-a7d1-4bb7-afed-e3f79b85eb40 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:33.995935 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3a514ad1-a7d1-4bb7-afed-e3f79b85eb40 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:33.996882 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3a514ad1-a7d1-4bb7-afed-e3f79b85eb40 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:33.999128 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3a514ad1-a7d1-4bb7-afed-e3f79b85eb40 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:34.168744 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3a514ad1-a7d1-4bb7-afed-e3f79b85eb40 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:34.177536 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3a514ad1-a7d1-4bb7-afed-e3f79b85eb40 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:34.179951 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3a514ad1-a7d1-4bb7-afed-e3f79b85eb40 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:34.181535 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3a514ad1-a7d1-4bb7-afed-e3f79b85eb40 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1740 microversion: 2.20 time: 0.207227 Jan 05 15:05:34.182446 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 431/870] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:33 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:34.423156 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4b7e9c75-f099-4e13-82bc-0bfe92606167 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:34.424427 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4b7e9c75-f099-4e13-82bc-0bfe92606167 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:34.432632 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b7e9c75-f099-4e13-82bc-0bfe92606167 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:34.433515 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b7e9c75-f099-4e13-82bc-0bfe92606167 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:34.434426 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b7e9c75-f099-4e13-82bc-0bfe92606167 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:34.434968 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b7e9c75-f099-4e13-82bc-0bfe92606167 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:34.467427 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b7e9c75-f099-4e13-82bc-0bfe92606167 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:34.468294 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b7e9c75-f099-4e13-82bc-0bfe92606167 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:34.468941 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-4b7e9c75-f099-4e13-82bc-0bfe92606167 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lazy-loading 'fault' on Instance uuid 62d39a5b-dac1-4667-b829-53506cf0c62b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:05:34.522282 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4b7e9c75-f099-4e13-82bc-0bfe92606167 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de1d8ec06134669a4db8ca248feceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:34.532319 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4b7e9c75-f099-4e13-82bc-0bfe92606167 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 200 len: 1326 microversion: 2.1 time: 0.113315 Jan 05 15:05:34.541970 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 440/871] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:34 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 1326 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:05:35.199540 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a37ae6ae-5ab1-4e5f-ba9e-33a6f59207af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:35.200735 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a37ae6ae-5ab1-4e5f-ba9e-33a6f59207af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:35.209481 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a37ae6ae-5ab1-4e5f-ba9e-33a6f59207af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:35.211112 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a37ae6ae-5ab1-4e5f-ba9e-33a6f59207af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:35.213384 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a37ae6ae-5ab1-4e5f-ba9e-33a6f59207af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:35.214729 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a37ae6ae-5ab1-4e5f-ba9e-33a6f59207af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:35.395513 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a37ae6ae-5ab1-4e5f-ba9e-33a6f59207af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:35.405352 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a37ae6ae-5ab1-4e5f-ba9e-33a6f59207af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:35.406933 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a37ae6ae-5ab1-4e5f-ba9e-33a6f59207af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:35.408405 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a37ae6ae-5ab1-4e5f-ba9e-33a6f59207af tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1740 microversion: 2.20 time: 0.212620 Jan 05 15:05:35.408970 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 432/872] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:35 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:35.549013 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd0c51e4-c817-4169-8a0d-9db8b8ef1925 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:35.549643 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bd0c51e4-c817-4169-8a0d-9db8b8ef1925 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:35.558199 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd0c51e4-c817-4169-8a0d-9db8b8ef1925 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:35.564172 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd0c51e4-c817-4169-8a0d-9db8b8ef1925 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:35.565374 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd0c51e4-c817-4169-8a0d-9db8b8ef1925 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:35.566050 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd0c51e4-c817-4169-8a0d-9db8b8ef1925 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:35.581675 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-bd0c51e4-c817-4169-8a0d-9db8b8ef1925 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] HTTP exception thrown: Instance 62d39a5b-dac1-4667-b829-53506cf0c62b could not be found. Jan 05 15:05:35.582670 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd0c51e4-c817-4169-8a0d-9db8b8ef1925 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Returning 404 to user: Instance 62d39a5b-dac1-4667-b829-53506cf0c62b could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:05:35.583723 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bd0c51e4-c817-4169-8a0d-9db8b8ef1925 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 404 len: 111 microversion: 2.1 time: 0.038426 Jan 05 15:05:35.588249 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 441/873] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:35 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:05:35.592690 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-58e69e36-0af6-44d7-bcfd-83c17c4b8174 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '.version_select at 0x7f2172341f70>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:35.682077 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-58e69e36-0af6-44d7-bcfd-83c17c4b8174 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-976524188" status: 202 len: 0 microversion: 2.1 time: 0.092904 Jan 05 15:05:35.682880 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 433/874] 10.222.0.30 () {58 vars in 1217 bytes} [Wed Jan 5 15:05:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-976524188 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:05:36.426116 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-31c5bc06-e69a-4dcc-8c28-ab68af86098e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:36.426728 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-31c5bc06-e69a-4dcc-8c28-ab68af86098e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:36.434388 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31c5bc06-e69a-4dcc-8c28-ab68af86098e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:36.435074 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31c5bc06-e69a-4dcc-8c28-ab68af86098e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:36.436728 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31c5bc06-e69a-4dcc-8c28-ab68af86098e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:36.437408 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31c5bc06-e69a-4dcc-8c28-ab68af86098e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:36.631730 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-31c5bc06-e69a-4dcc-8c28-ab68af86098e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:36.652864 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-31c5bc06-e69a-4dcc-8c28-ab68af86098e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:36.654631 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-31c5bc06-e69a-4dcc-8c28-ab68af86098e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:36.658169 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-31c5bc06-e69a-4dcc-8c28-ab68af86098e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1740 microversion: 2.20 time: 0.235756 Jan 05 15:05:36.658754 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 442/875] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:36 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:37.678490 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b8f19c31-e93e-4f6d-857a-61fe64407459 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:37.679752 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b8f19c31-e93e-4f6d-857a-61fe64407459 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:37.686025 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b8f19c31-e93e-4f6d-857a-61fe64407459 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:37.686692 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b8f19c31-e93e-4f6d-857a-61fe64407459 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:37.687623 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b8f19c31-e93e-4f6d-857a-61fe64407459 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:37.688294 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b8f19c31-e93e-4f6d-857a-61fe64407459 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:37.836904 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b8f19c31-e93e-4f6d-857a-61fe64407459 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:37.844898 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b8f19c31-e93e-4f6d-857a-61fe64407459 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:37.846464 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b8f19c31-e93e-4f6d-857a-61fe64407459 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:37.847626 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b8f19c31-e93e-4f6d-857a-61fe64407459 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1740 microversion: 2.20 time: 0.173556 Jan 05 15:05:37.848237 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 434/876] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:37 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:38.867080 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-771497a4-8449-4657-9bc2-716b332cd461 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:38.868350 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-771497a4-8449-4657-9bc2-716b332cd461 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:38.874747 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-771497a4-8449-4657-9bc2-716b332cd461 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:38.875192 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-771497a4-8449-4657-9bc2-716b332cd461 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:38.876704 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-771497a4-8449-4657-9bc2-716b332cd461 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:38.877157 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-771497a4-8449-4657-9bc2-716b332cd461 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:39.010669 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-771497a4-8449-4657-9bc2-716b332cd461 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:39.018418 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-771497a4-8449-4657-9bc2-716b332cd461 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:39.020022 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-771497a4-8449-4657-9bc2-716b332cd461 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:39.021211 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-771497a4-8449-4657-9bc2-716b332cd461 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1722 microversion: 2.20 time: 0.157841 Jan 05 15:05:39.021773 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 443/877] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:38 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:39.645869 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1493d12b-f3f7-4090-a8f5-29870d244847 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:39.646366 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1493d12b-f3f7-4090-a8f5-29870d244847 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:39.656759 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1493d12b-f3f7-4090-a8f5-29870d244847 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:39.656759 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1493d12b-f3f7-4090-a8f5-29870d244847 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:39.656759 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1493d12b-f3f7-4090-a8f5-29870d244847 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:39.656759 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1493d12b-f3f7-4090-a8f5-29870d244847 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:39.667909 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-1493d12b-f3f7-4090-a8f5-29870d244847 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] HTTP exception thrown: Instance 62d39a5b-dac1-4667-b829-53506cf0c62b could not be found. Jan 05 15:05:39.668601 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1493d12b-f3f7-4090-a8f5-29870d244847 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Returning 404 to user: Instance 62d39a5b-dac1-4667-b829-53506cf0c62b could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:05:39.669469 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1493d12b-f3f7-4090-a8f5-29870d244847 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "DELETE /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 404 len: 111 microversion: 2.1 time: 0.027316 Jan 05 15:05:39.670003 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 435/878] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:05:39 2022] DELETE /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:05:39.677795 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8b974940-7dff-4f22-9013-f91dd34beb6b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:39.678413 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8b974940-7dff-4f22-9013-f91dd34beb6b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 62d39a5b-dac1-4667-b829-53506cf0c62b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:39.684299 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b974940-7dff-4f22-9013-f91dd34beb6b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:39.684756 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b974940-7dff-4f22-9013-f91dd34beb6b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:39.685573 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b974940-7dff-4f22-9013-f91dd34beb6b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:39.686012 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b974940-7dff-4f22-9013-f91dd34beb6b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:39.700819 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-8b974940-7dff-4f22-9013-f91dd34beb6b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] HTTP exception thrown: Instance 62d39a5b-dac1-4667-b829-53506cf0c62b could not be found. Jan 05 15:05:39.701424 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8b974940-7dff-4f22-9013-f91dd34beb6b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Returning 404 to user: Instance 62d39a5b-dac1-4667-b829-53506cf0c62b could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:05:39.702230 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8b974940-7dff-4f22-9013-f91dd34beb6b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b" status: 404 len: 111 microversion: 2.1 time: 0.028184 Jan 05 15:05:39.702743 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 444/879] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:39 2022] GET /compute/v2.1/servers/62d39a5b-dac1-4667-b829-53506cf0c62b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:05:40.039435 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e01fd278-6b99-40fe-b5f3-60fb2fcad705 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:40.040034 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e01fd278-6b99-40fe-b5f3-60fb2fcad705 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:40.045851 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e01fd278-6b99-40fe-b5f3-60fb2fcad705 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:40.046296 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e01fd278-6b99-40fe-b5f3-60fb2fcad705 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:40.047062 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e01fd278-6b99-40fe-b5f3-60fb2fcad705 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:40.047494 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e01fd278-6b99-40fe-b5f3-60fb2fcad705 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:40.175449 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e01fd278-6b99-40fe-b5f3-60fb2fcad705 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:40.183706 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e01fd278-6b99-40fe-b5f3-60fb2fcad705 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:40.185276 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e01fd278-6b99-40fe-b5f3-60fb2fcad705 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:40.186427 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e01fd278-6b99-40fe-b5f3-60fb2fcad705 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1722 microversion: 2.20 time: 0.150711 Jan 05 15:05:40.186979 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 436/880] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:40 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:40.964662 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f789c28c-ac8d-41d4-ad3a-ccbc78450630 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:40.965222 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f789c28c-ac8d-41d4-ad3a-ccbc78450630 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:40.971423 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f789c28c-ac8d-41d4-ad3a-ccbc78450630 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:40.971870 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f789c28c-ac8d-41d4-ad3a-ccbc78450630 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:40.972643 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f789c28c-ac8d-41d4-ad3a-ccbc78450630 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:40.973089 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f789c28c-ac8d-41d4-ad3a-ccbc78450630 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:40.987272 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f789c28c-ac8d-41d4-ad3a-ccbc78450630 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] HTTP exception thrown: Instance 3327c27f-a8e9-4b19-8041-fb5260278159 could not be found. Jan 05 15:05:40.987848 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f789c28c-ac8d-41d4-ad3a-ccbc78450630 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Returning 404 to user: Instance 3327c27f-a8e9-4b19-8041-fb5260278159 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:05:40.988651 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f789c28c-ac8d-41d4-ad3a-ccbc78450630 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 404 len: 111 microversion: 2.1 time: 0.027768 Jan 05 15:05:40.989193 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 445/881] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:05:40 2022] DELETE /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:05:40.997433 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b9b4016e-ca3e-42ba-9ce5-9f50e3b1bf61 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:40.998035 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b9b4016e-ca3e-42ba-9ce5-9f50e3b1bf61 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] [instance: 3327c27f-a8e9-4b19-8041-fb5260278159] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:41.004320 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b9b4016e-ca3e-42ba-9ce5-9f50e3b1bf61 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:41.004775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b9b4016e-ca3e-42ba-9ce5-9f50e3b1bf61 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:41.005550 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b9b4016e-ca3e-42ba-9ce5-9f50e3b1bf61 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:41.005983 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b9b4016e-ca3e-42ba-9ce5-9f50e3b1bf61 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:41.019279 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-b9b4016e-ca3e-42ba-9ce5-9f50e3b1bf61 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] HTTP exception thrown: Instance 3327c27f-a8e9-4b19-8041-fb5260278159 could not be found. Jan 05 15:05:41.019843 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b9b4016e-ca3e-42ba-9ce5-9f50e3b1bf61 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Returning 404 to user: Instance 3327c27f-a8e9-4b19-8041-fb5260278159 could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:05:41.020637 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b9b4016e-ca3e-42ba-9ce5-9f50e3b1bf61 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159" status: 404 len: 111 microversion: 2.1 time: 0.026985 Jan 05 15:05:41.021162 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 437/882] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:40 2022] GET /compute/v2.1/servers/3327c27f-a8e9-4b19-8041-fb5260278159 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:05:41.208446 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6f85610d-b301-462e-a280-770ace480a19 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:41.208446 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6f85610d-b301-462e-a280-770ace480a19 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:41.212335 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f85610d-b301-462e-a280-770ace480a19 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:41.213178 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f85610d-b301-462e-a280-770ace480a19 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:41.214566 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f85610d-b301-462e-a280-770ace480a19 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:41.215349 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f85610d-b301-462e-a280-770ace480a19 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:41.374410 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6f85610d-b301-462e-a280-770ace480a19 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:41.374410 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6f85610d-b301-462e-a280-770ace480a19 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:41.374710 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6f85610d-b301-462e-a280-770ace480a19 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:41.374710 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6f85610d-b301-462e-a280-770ace480a19 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1722 microversion: 2.20 time: 0.165320 Jan 05 15:05:41.374710 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 446/883] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:41 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:05:42.385907 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-49dab8b9-f7cc-4182-bb21-2ed0fc75647b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:42.386641 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-49dab8b9-f7cc-4182-bb21-2ed0fc75647b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:42.397973 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a14277fe-b79e-42c2-aabb-d69482648f7d req-1f9682e2-b1bc-4ff5-85b2-92c5d5292f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "name": "network-vif-unplugged", "status": "completed", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:42.400475 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:05:42.400475 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:05:42.406312 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-49dab8b9-f7cc-4182-bb21-2ed0fc75647b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:42.413043 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-49dab8b9-f7cc-4182-bb21-2ed0fc75647b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:42.413043 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-49dab8b9-f7cc-4182-bb21-2ed0fc75647b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:42.413043 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-49dab8b9-f7cc-4182-bb21-2ed0fc75647b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:42.414839 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a14277fe-b79e-42c2-aabb-d69482648f7d req-1f9682e2-b1bc-4ff5-85b2-92c5d5292f03 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:42.417431 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a14277fe-b79e-42c2-aabb-d69482648f7d req-1f9682e2-b1bc-4ff5-85b2-92c5d5292f03 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:42.435497 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.compute.server_external_events [req-a14277fe-b79e-42c2-aabb-d69482648f7d req-1f9682e2-b1bc-4ff5-85b2-92c5d5292f03 service nova] Unable to find a host for instance a591f495-ff59-4865-87ea-c48041ea097f. Dropping event network-vif-unplugged {{(pid=128788) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 05 15:05:42.437000 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a14277fe-b79e-42c2-aabb-d69482648f7d req-1f9682e2-b1bc-4ff5-85b2-92c5d5292f03 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043191 Jan 05 15:05:42.447925 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 447/884] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 05 15:05:42.650746 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-49dab8b9-f7cc-4182-bb21-2ed0fc75647b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:42.658493 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-49dab8b9-f7cc-4182-bb21-2ed0fc75647b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:42.659987 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-49dab8b9-f7cc-4182-bb21-2ed0fc75647b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:42.661140 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-49dab8b9-f7cc-4182-bb21-2ed0fc75647b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1665 microversion: 2.20 time: 0.279319 Jan 05 15:05:42.661761 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 438/885] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:42 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1665 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:42.679383 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e89d0542-2a58-494b-9f4b-d1de25f00cdd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ba9c82b-b4ff-483a-a17b-15dee8d05e69"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:42.681008 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e89d0542-2a58-494b-9f4b-d1de25f00cdd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:42.687109 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e89d0542-2a58-494b-9f4b-d1de25f00cdd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:42.687566 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e89d0542-2a58-494b-9f4b-d1de25f00cdd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:42.688368 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e89d0542-2a58-494b-9f4b-d1de25f00cdd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:42.688788 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e89d0542-2a58-494b-9f4b-d1de25f00cdd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:43.811196 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e89d0542-2a58-494b-9f4b-d1de25f00cdd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.135166 Jan 05 15:05:43.818109 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 448/886] 10.222.0.30 () {62 vars in 1363 bytes} [Wed Jan 5 15:05:42 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/os-volume_attachments => generated 188 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 15:05:43.928848 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-57d43106-418c-403b-bc3f-0a33ee2b7c18 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:43.932713 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-57d43106-418c-403b-bc3f-0a33ee2b7c18 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:43.935764 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-57d43106-418c-403b-bc3f-0a33ee2b7c18 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:43.936210 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-57d43106-418c-403b-bc3f-0a33ee2b7c18 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:43.936983 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-57d43106-418c-403b-bc3f-0a33ee2b7c18 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:43.937448 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-57d43106-418c-403b-bc3f-0a33ee2b7c18 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:44.621262 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-57d43106-418c-403b-bc3f-0a33ee2b7c18 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/os-volume_attachments/7ba9c82b-b4ff-483a-a17b-15dee8d05e69" status: 202 len: 0 microversion: 2.20 time: 0.695915 Jan 05 15:05:44.621836 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 439/887] 10.222.0.30 () {60 vars in 1456 bytes} [Wed Jan 5 15:05:43 2022] DELETE /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/os-volume_attachments/7ba9c82b-b4ff-483a-a17b-15dee8d05e69 => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:05:44.707565 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-17ffab96-2400-48c7-a52f-ef753d1ec9ee tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:44.708127 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-17ffab96-2400-48c7-a52f-ef753d1ec9ee tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:44.715746 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17ffab96-2400-48c7-a52f-ef753d1ec9ee tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:44.719584 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17ffab96-2400-48c7-a52f-ef753d1ec9ee tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:44.719584 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17ffab96-2400-48c7-a52f-ef753d1ec9ee tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:44.719584 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17ffab96-2400-48c7-a52f-ef753d1ec9ee tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:45.018120 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-17ffab96-2400-48c7-a52f-ef753d1ec9ee tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action" status: 202 len: 0 microversion: 2.20 time: 0.314603 Jan 05 15:05:45.026544 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2d41c9d0-634c-4a6e-8319-4a4fb51af588 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:45.027155 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2d41c9d0-634c-4a6e-8319-4a4fb51af588 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:45.030080 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 449/888] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Jan 5 15:05:44 2022] POST /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:05:45.033466 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2d41c9d0-634c-4a6e-8319-4a4fb51af588 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:45.034110 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2d41c9d0-634c-4a6e-8319-4a4fb51af588 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:45.035117 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2d41c9d0-634c-4a6e-8319-4a4fb51af588 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:45.035674 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2d41c9d0-634c-4a6e-8319-4a4fb51af588 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:45.283528 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-2d41c9d0-634c-4a6e-8319-4a4fb51af588 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:45.292477 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-2d41c9d0-634c-4a6e-8319-4a4fb51af588 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:45.293600 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-2d41c9d0-634c-4a6e-8319-4a4fb51af588 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:45.294753 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2d41c9d0-634c-4a6e-8319-4a4fb51af588 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1673 microversion: 2.20 time: 0.271912 Jan 05 15:05:45.295310 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 440/889] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:45 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1673 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:46.313340 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bfb5e96e-858d-4fac-99c0-aa90c20cdaf6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:46.314626 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bfb5e96e-858d-4fac-99c0-aa90c20cdaf6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:46.320929 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfb5e96e-858d-4fac-99c0-aa90c20cdaf6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:46.324813 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfb5e96e-858d-4fac-99c0-aa90c20cdaf6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:46.324813 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfb5e96e-858d-4fac-99c0-aa90c20cdaf6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:46.324813 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfb5e96e-858d-4fac-99c0-aa90c20cdaf6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:46.454848 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-bfb5e96e-858d-4fac-99c0-aa90c20cdaf6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:46.462871 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-bfb5e96e-858d-4fac-99c0-aa90c20cdaf6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:46.465004 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-bfb5e96e-858d-4fac-99c0-aa90c20cdaf6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:46.465516 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bfb5e96e-858d-4fac-99c0-aa90c20cdaf6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1673 microversion: 2.20 time: 0.156421 Jan 05 15:05:46.466210 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 450/890] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:46 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:47.483790 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-abdf66bb-7fde-4b33-8295-06099d09b19c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:47.484599 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-abdf66bb-7fde-4b33-8295-06099d09b19c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:47.491705 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-abdf66bb-7fde-4b33-8295-06099d09b19c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:47.492761 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-abdf66bb-7fde-4b33-8295-06099d09b19c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:47.493807 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-abdf66bb-7fde-4b33-8295-06099d09b19c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:47.494237 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-abdf66bb-7fde-4b33-8295-06099d09b19c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:47.703863 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-abdf66bb-7fde-4b33-8295-06099d09b19c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:47.712183 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-abdf66bb-7fde-4b33-8295-06099d09b19c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:47.713951 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-abdf66bb-7fde-4b33-8295-06099d09b19c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:47.715274 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-abdf66bb-7fde-4b33-8295-06099d09b19c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1731 microversion: 2.20 time: 0.235277 Jan 05 15:05:47.715983 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 441/891] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:47 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1731 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:48.736495 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa6f2927-f50c-4d4d-8973-49f9abec627c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:48.737111 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa6f2927-f50c-4d4d-8973-49f9abec627c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:48.744586 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa6f2927-f50c-4d4d-8973-49f9abec627c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:48.749247 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa6f2927-f50c-4d4d-8973-49f9abec627c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:48.750368 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa6f2927-f50c-4d4d-8973-49f9abec627c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:48.751055 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa6f2927-f50c-4d4d-8973-49f9abec627c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:48.919703 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-aa6f2927-f50c-4d4d-8973-49f9abec627c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:48.928309 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-aa6f2927-f50c-4d4d-8973-49f9abec627c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:48.930185 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-aa6f2927-f50c-4d4d-8973-49f9abec627c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:48.932300 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aa6f2927-f50c-4d4d-8973-49f9abec627c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1731 microversion: 2.20 time: 0.199603 Jan 05 15:05:48.933327 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 451/892] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:48 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1731 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:48.978446 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-38cb3675-5dd2-4313-ab98-17485aeefd47 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1530291897", "imageRef": "e4c11159-1e41-437a-af97-eb5f10704ae6", "flavorRef": "452", "networks": [{"uuid": "15d9f439-989e-49bd-a540-259f7f374d29"}]}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:49.032269 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.network.neutron [None req-38cb3675-5dd2-4313-ab98-17485aeefd47 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] validate_networks() for [('15d9f439-989e-49bd-a540-259f7f374d29', None, None, None, None, None)] {{(pid=128789) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 15:05:49.441571 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-38cb3675-5dd2-4313-ab98-17485aeefd47 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Flavor limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 15:05:49.442099 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-38cb3675-5dd2-4313-ab98-17485aeefd47 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Image limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 15:05:49.442660 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-38cb3675-5dd2-4313-ab98-17485aeefd47 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Flavor pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 15:05:49.443131 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-38cb3675-5dd2-4313-ab98-17485aeefd47 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Image pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 15:05:49.443602 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-38cb3675-5dd2-4313-ab98-17485aeefd47 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 15:05:49.452703 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-38cb3675-5dd2-4313-ab98-17485aeefd47 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:49.453185 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-38cb3675-5dd2-4313-ab98-17485aeefd47 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:49.453996 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-38cb3675-5dd2-4313-ab98-17485aeefd47 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:49.454428 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-38cb3675-5dd2-4313-ab98-17485aeefd47 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:49.471069 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-38cb3675-5dd2-4313-ab98-17485aeefd47 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Getting quotas for project 97821d0c0c79446abba323f103c8244a. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:05:49.475072 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-38cb3675-5dd2-4313-ab98-17485aeefd47 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Getting quotas for user e1578e40c006442ca632381e242d35bf and project 97821d0c0c79446abba323f103c8244a. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:05:49.487083 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-38cb3675-5dd2-4313-ab98-17485aeefd47 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Going to run 1 instances... {{(pid=128789) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 15:05:49.489673 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-38cb3675-5dd2-4313-ab98-17485aeefd47 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4c11159-1e41-437a-af97-eb5f10704ae6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 15:05:49.637121 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-38cb3675-5dd2-4313-ab98-17485aeefd47 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817990 Jan 05 15:05:49.638369 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 442/893] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 15:05:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 15:05:49.648155 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f79132f5-18ef-4218-8cd8-0de755e1565f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:49.650295 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f79132f5-18ef-4218-8cd8-0de755e1565f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:49.708854 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-f79132f5-18ef-4218-8cd8-0de755e1565f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:49.718479 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f79132f5-18ef-4218-8cd8-0de755e1565f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1218 microversion: 2.1 time: 0.073878 Jan 05 15:05:49.729162 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 452/894] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:49 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:05:49.958787 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-caf0b2c1-ebf2-418c-bf25-d01bf035235b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:49.960415 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-caf0b2c1-ebf2-418c-bf25-d01bf035235b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:49.966420 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-caf0b2c1-ebf2-418c-bf25-d01bf035235b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:49.966868 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-caf0b2c1-ebf2-418c-bf25-d01bf035235b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:49.968162 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-caf0b2c1-ebf2-418c-bf25-d01bf035235b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:49.968631 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-caf0b2c1-ebf2-418c-bf25-d01bf035235b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:50.136202 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-caf0b2c1-ebf2-418c-bf25-d01bf035235b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:50.144004 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-caf0b2c1-ebf2-418c-bf25-d01bf035235b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:50.145525 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-caf0b2c1-ebf2-418c-bf25-d01bf035235b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:50.146819 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-caf0b2c1-ebf2-418c-bf25-d01bf035235b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1731 microversion: 2.20 time: 0.192287 Jan 05 15:05:50.147434 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 443/895] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:49 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:50.740033 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ac7ebb0d-a05f-40d0-9f2d-2a4a9fda335a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:50.741978 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ac7ebb0d-a05f-40d0-9f2d-2a4a9fda335a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:50.824590 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-ac7ebb0d-a05f-40d0-9f2d-2a4a9fda335a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:50.832260 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ac7ebb0d-a05f-40d0-9f2d-2a4a9fda335a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1218 microversion: 2.1 time: 0.099847 Jan 05 15:05:50.838645 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 453/896] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:50 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:05:51.167123 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2feb34e9-7ce3-449d-8dee-6049431d802b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:51.168409 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2feb34e9-7ce3-449d-8dee-6049431d802b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:51.176029 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2feb34e9-7ce3-449d-8dee-6049431d802b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:51.176483 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2feb34e9-7ce3-449d-8dee-6049431d802b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:51.177312 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2feb34e9-7ce3-449d-8dee-6049431d802b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:51.177749 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2feb34e9-7ce3-449d-8dee-6049431d802b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:51.328954 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-2feb34e9-7ce3-449d-8dee-6049431d802b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:51.337291 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-2feb34e9-7ce3-449d-8dee-6049431d802b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:51.338794 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-2feb34e9-7ce3-449d-8dee-6049431d802b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:51.339945 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2feb34e9-7ce3-449d-8dee-6049431d802b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1731 microversion: 2.20 time: 0.177236 Jan 05 15:05:51.341120 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 444/897] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:51 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:51.849695 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3cabb11a-9cb6-4e45-88d4-b5fb4a8e7796 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:51.850954 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3cabb11a-9cb6-4e45-88d4-b5fb4a8e7796 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:51.858079 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cabb11a-9cb6-4e45-88d4-b5fb4a8e7796 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:51.858806 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cabb11a-9cb6-4e45-88d4-b5fb4a8e7796 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:51.860326 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cabb11a-9cb6-4e45-88d4-b5fb4a8e7796 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:51.860953 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cabb11a-9cb6-4e45-88d4-b5fb4a8e7796 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:51.922213 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3cabb11a-9cb6-4e45-88d4-b5fb4a8e7796 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:51.929887 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3cabb11a-9cb6-4e45-88d4-b5fb4a8e7796 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1222 microversion: 2.1 time: 0.084336 Jan 05 15:05:51.930795 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 454/898] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:51 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:05:52.360397 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-22d81f21-7fd1-4207-9882-f84056d714e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:52.361912 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-22d81f21-7fd1-4207-9882-f84056d714e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:52.369777 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-22d81f21-7fd1-4207-9882-f84056d714e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:52.370229 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-22d81f21-7fd1-4207-9882-f84056d714e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:52.371027 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-22d81f21-7fd1-4207-9882-f84056d714e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:52.371470 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-22d81f21-7fd1-4207-9882-f84056d714e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:52.529663 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-22d81f21-7fd1-4207-9882-f84056d714e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:52.538104 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-22d81f21-7fd1-4207-9882-f84056d714e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:52.539667 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-22d81f21-7fd1-4207-9882-f84056d714e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:52.540831 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-22d81f21-7fd1-4207-9882-f84056d714e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1731 microversion: 2.20 time: 0.185279 Jan 05 15:05:52.545113 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 445/899] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:52 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:52.946132 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c4265ec1-a23f-4c3e-bed8-8d5dd502aef3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:52.946745 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c4265ec1-a23f-4c3e-bed8-8d5dd502aef3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:52.953200 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4265ec1-a23f-4c3e-bed8-8d5dd502aef3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:52.953632 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4265ec1-a23f-4c3e-bed8-8d5dd502aef3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:52.954438 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4265ec1-a23f-4c3e-bed8-8d5dd502aef3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:52.954842 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4265ec1-a23f-4c3e-bed8-8d5dd502aef3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:53.020275 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-c4265ec1-a23f-4c3e-bed8-8d5dd502aef3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:53.027870 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c4265ec1-a23f-4c3e-bed8-8d5dd502aef3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1222 microversion: 2.1 time: 0.085927 Jan 05 15:05:53.028440 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 455/900] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:52 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:05:53.559271 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-fed05e68-8c01-4fcb-92eb-f003b1c6a0df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:53.560580 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-fed05e68-8c01-4fcb-92eb-f003b1c6a0df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:53.567443 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fed05e68-8c01-4fcb-92eb-f003b1c6a0df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:53.567898 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fed05e68-8c01-4fcb-92eb-f003b1c6a0df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:53.568693 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fed05e68-8c01-4fcb-92eb-f003b1c6a0df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:53.570258 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fed05e68-8c01-4fcb-92eb-f003b1c6a0df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:53.719643 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-fed05e68-8c01-4fcb-92eb-f003b1c6a0df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:53.728357 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-fed05e68-8c01-4fcb-92eb-f003b1c6a0df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:53.734598 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-fed05e68-8c01-4fcb-92eb-f003b1c6a0df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:53.734598 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-fed05e68-8c01-4fcb-92eb-f003b1c6a0df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1731 microversion: 2.20 time: 0.175503 Jan 05 15:05:53.734598 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 446/901] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:53 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:54.046648 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9b73cfd7-b312-464b-974a-89159789719e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:54.047392 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9b73cfd7-b312-464b-974a-89159789719e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:54.054038 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b73cfd7-b312-464b-974a-89159789719e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:54.055197 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b73cfd7-b312-464b-974a-89159789719e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:54.055993 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b73cfd7-b312-464b-974a-89159789719e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:54.056489 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b73cfd7-b312-464b-974a-89159789719e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:54.129266 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-9b73cfd7-b312-464b-974a-89159789719e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:54.137487 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9b73cfd7-b312-464b-974a-89159789719e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1222 microversion: 2.1 time: 0.096193 Jan 05 15:05:54.138176 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 456/902] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:54 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:05:54.750405 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-9a0884ba-ff25-4a3c-98e0-ab7fb39a6d59 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:54.751216 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-9a0884ba-ff25-4a3c-98e0-ab7fb39a6d59 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:54.758565 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9a0884ba-ff25-4a3c-98e0-ab7fb39a6d59 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:54.759036 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9a0884ba-ff25-4a3c-98e0-ab7fb39a6d59 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:54.759804 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9a0884ba-ff25-4a3c-98e0-ab7fb39a6d59 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:54.760233 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9a0884ba-ff25-4a3c-98e0-ab7fb39a6d59 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:54.936459 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-9a0884ba-ff25-4a3c-98e0-ab7fb39a6d59 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:54.936459 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-9a0884ba-ff25-4a3c-98e0-ab7fb39a6d59 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:54.936756 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-9a0884ba-ff25-4a3c-98e0-ab7fb39a6d59 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:54.936756 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-9a0884ba-ff25-4a3c-98e0-ab7fb39a6d59 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1731 microversion: 2.20 time: 0.179873 Jan 05 15:05:54.936756 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 447/903] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:54 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:55.155191 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2c8e6be7-1708-4ea8-bd35-9f692cc70e99 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:55.155815 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2c8e6be7-1708-4ea8-bd35-9f692cc70e99 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:55.162361 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c8e6be7-1708-4ea8-bd35-9f692cc70e99 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:55.162817 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c8e6be7-1708-4ea8-bd35-9f692cc70e99 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:55.163655 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c8e6be7-1708-4ea8-bd35-9f692cc70e99 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:55.164268 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c8e6be7-1708-4ea8-bd35-9f692cc70e99 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:55.232612 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-2c8e6be7-1708-4ea8-bd35-9f692cc70e99 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:55.241272 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2c8e6be7-1708-4ea8-bd35-9f692cc70e99 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1222 microversion: 2.1 time: 0.090270 Jan 05 15:05:55.242389 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 457/904] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:55 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:05:55.944871 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-97c08beb-88a1-4575-b7ec-bcfbc689d629 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:55.946615 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-97c08beb-88a1-4575-b7ec-bcfbc689d629 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:55.954122 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-97c08beb-88a1-4575-b7ec-bcfbc689d629 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:55.954671 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-97c08beb-88a1-4575-b7ec-bcfbc689d629 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:55.955471 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-97c08beb-88a1-4575-b7ec-bcfbc689d629 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:55.956005 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-97c08beb-88a1-4575-b7ec-bcfbc689d629 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:56.111908 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-97c08beb-88a1-4575-b7ec-bcfbc689d629 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:56.124401 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-97c08beb-88a1-4575-b7ec-bcfbc689d629 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:56.127125 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-97c08beb-88a1-4575-b7ec-bcfbc689d629 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:56.128653 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-97c08beb-88a1-4575-b7ec-bcfbc689d629 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1731 microversion: 2.20 time: 0.188066 Jan 05 15:05:56.129960 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 448/905] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:55 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:05:56.258079 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ee903717-9a26-418f-a326-e3cdb63a8208 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:56.258826 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ee903717-9a26-418f-a326-e3cdb63a8208 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:56.265187 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee903717-9a26-418f-a326-e3cdb63a8208 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:56.265629 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee903717-9a26-418f-a326-e3cdb63a8208 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:56.266423 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee903717-9a26-418f-a326-e3cdb63a8208 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:56.266846 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee903717-9a26-418f-a326-e3cdb63a8208 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:56.323382 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-ee903717-9a26-418f-a326-e3cdb63a8208 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:56.330538 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ee903717-9a26-418f-a326-e3cdb63a8208 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1222 microversion: 2.1 time: 0.076192 Jan 05 15:05:56.331093 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 458/906] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:56 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:05:57.147083 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-67ff655e-c709-42b2-8227-dd853660e909 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:57.147684 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-67ff655e-c709-42b2-8227-dd853660e909 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:57.154048 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-67ff655e-c709-42b2-8227-dd853660e909 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:57.154494 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-67ff655e-c709-42b2-8227-dd853660e909 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:57.155272 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-67ff655e-c709-42b2-8227-dd853660e909 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:57.155727 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-67ff655e-c709-42b2-8227-dd853660e909 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:57.283714 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-67ff655e-c709-42b2-8227-dd853660e909 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:57.292060 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-67ff655e-c709-42b2-8227-dd853660e909 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:57.293622 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-67ff655e-c709-42b2-8227-dd853660e909 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:57.294791 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-67ff655e-c709-42b2-8227-dd853660e909 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1731 microversion: 2.20 time: 0.151411 Jan 05 15:05:57.295345 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 449/907] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:57 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:57.346372 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dee4df59-a535-4de7-a459-6b0104885e74 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:57.346976 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dee4df59-a535-4de7-a459-6b0104885e74 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:57.354075 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dee4df59-a535-4de7-a459-6b0104885e74 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:57.354521 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dee4df59-a535-4de7-a459-6b0104885e74 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:57.355299 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dee4df59-a535-4de7-a459-6b0104885e74 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:57.355732 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dee4df59-a535-4de7-a459-6b0104885e74 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:57.416190 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-dee4df59-a535-4de7-a459-6b0104885e74 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:57.423735 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dee4df59-a535-4de7-a459-6b0104885e74 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1270 microversion: 2.1 time: 0.081040 Jan 05 15:05:57.424359 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 459/908] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:57 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:05:58.312581 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-51ab9eb2-ff96-4d08-b4bf-73cb867d2fa0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:58.313832 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-51ab9eb2-ff96-4d08-b4bf-73cb867d2fa0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:58.319988 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-51ab9eb2-ff96-4d08-b4bf-73cb867d2fa0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:58.320437 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-51ab9eb2-ff96-4d08-b4bf-73cb867d2fa0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:58.321807 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-51ab9eb2-ff96-4d08-b4bf-73cb867d2fa0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:58.322244 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-51ab9eb2-ff96-4d08-b4bf-73cb867d2fa0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:58.439465 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4560ee88-4a02-4764-b849-1fc8126a822a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:58.440854 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4560ee88-4a02-4764-b849-1fc8126a822a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:58.447357 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4560ee88-4a02-4764-b849-1fc8126a822a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:58.447809 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4560ee88-4a02-4764-b849-1fc8126a822a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:58.448600 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4560ee88-4a02-4764-b849-1fc8126a822a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:58.449033 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4560ee88-4a02-4764-b849-1fc8126a822a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:58.461264 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-51ab9eb2-ff96-4d08-b4bf-73cb867d2fa0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:58.470159 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-51ab9eb2-ff96-4d08-b4bf-73cb867d2fa0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:58.471958 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-51ab9eb2-ff96-4d08-b4bf-73cb867d2fa0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:58.473204 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-51ab9eb2-ff96-4d08-b4bf-73cb867d2fa0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1731 microversion: 2.20 time: 0.164278 Jan 05 15:05:58.473868 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 450/909] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:58 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:58.520297 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4560ee88-4a02-4764-b849-1fc8126a822a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:58.528194 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4560ee88-4a02-4764-b849-1fc8126a822a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1276 microversion: 2.1 time: 0.092399 Jan 05 15:05:58.528771 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 460/910] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:58 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:05:59.491843 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a1151795-3f7a-43f0-bc49-1247f7b16c38 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:59.492531 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a1151795-3f7a-43f0-bc49-1247f7b16c38 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:59.499051 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a1151795-3f7a-43f0-bc49-1247f7b16c38 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:59.499505 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a1151795-3f7a-43f0-bc49-1247f7b16c38 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:59.500289 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a1151795-3f7a-43f0-bc49-1247f7b16c38 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:59.500723 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a1151795-3f7a-43f0-bc49-1247f7b16c38 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:59.550100 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d3bf6304-9fd7-4ff2-a114-09e19a0f19eb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:05:59.550974 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d3bf6304-9fd7-4ff2-a114-09e19a0f19eb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:05:59.558702 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3bf6304-9fd7-4ff2-a114-09e19a0f19eb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:59.559409 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3bf6304-9fd7-4ff2-a114-09e19a0f19eb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:59.560662 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3bf6304-9fd7-4ff2-a114-09e19a0f19eb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:59.561564 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3bf6304-9fd7-4ff2-a114-09e19a0f19eb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:59.636856 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a1151795-3f7a-43f0-bc49-1247f7b16c38 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:59.645205 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a1151795-3f7a-43f0-bc49-1247f7b16c38 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:59.646916 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a1151795-3f7a-43f0-bc49-1247f7b16c38 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:59.648176 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a1151795-3f7a-43f0-bc49-1247f7b16c38 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1731 microversion: 2.20 time: 0.160132 Jan 05 15:05:59.648827 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 451/911] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:05:59 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:05:59.653891 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-1c9bb961-3d75-4158-aec0-742dcf3756b7 req-2daf9974-d8a3-4979-81dd-843c8eedbf77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c16547ce-867c-46c9-9117-9a3ff7f2b0e9", "tag": "906a8d4e-ebf8-4e84-9c63-6111c3e36d6b"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:05:59.655465 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:05:59.655465 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:05:59.662866 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-1c9bb961-3d75-4158-aec0-742dcf3756b7 req-2daf9974-d8a3-4979-81dd-843c8eedbf77 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:05:59.663414 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-1c9bb961-3d75-4158-aec0-742dcf3756b7 req-2daf9974-d8a3-4979-81dd-843c8eedbf77 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:05:59.674977 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-1c9bb961-3d75-4158-aec0-742dcf3756b7 req-2daf9974-d8a3-4979-81dd-843c8eedbf77 service nova] Creating event network-changed:906a8d4e-ebf8-4e84-9c63-6111c3e36d6b for instance c16547ce-867c-46c9-9117-9a3ff7f2b0e9 on hv-cinder-maste Jan 05 15:05:59.680260 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-1c9bb961-3d75-4158-aec0-742dcf3756b7 req-2daf9974-d8a3-4979-81dd-843c8eedbf77 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029559 Jan 05 15:05:59.681433 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 452/912] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:05:59.712901 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d3bf6304-9fd7-4ff2-a114-09e19a0f19eb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:05:59.721161 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d3bf6304-9fd7-4ff2-a114-09e19a0f19eb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1318 microversion: 2.1 time: 0.178359 Jan 05 15:05:59.725319 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 461/913] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:05:59 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:00.667572 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-72f7926e-f03a-4ab2-b7e9-dc77f787468b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:00.668268 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-72f7926e-f03a-4ab2-b7e9-dc77f787468b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:00.674868 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-72f7926e-f03a-4ab2-b7e9-dc77f787468b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:00.675313 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-72f7926e-f03a-4ab2-b7e9-dc77f787468b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:00.676079 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-72f7926e-f03a-4ab2-b7e9-dc77f787468b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:00.676507 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-72f7926e-f03a-4ab2-b7e9-dc77f787468b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:00.738038 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-92cbe96b-f5b9-49d9-8f35-2a05ef33701e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:00.738643 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-92cbe96b-f5b9-49d9-8f35-2a05ef33701e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:00.745252 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92cbe96b-f5b9-49d9-8f35-2a05ef33701e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:00.745706 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92cbe96b-f5b9-49d9-8f35-2a05ef33701e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:00.746494 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92cbe96b-f5b9-49d9-8f35-2a05ef33701e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:00.747194 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92cbe96b-f5b9-49d9-8f35-2a05ef33701e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:00.811891 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-72f7926e-f03a-4ab2-b7e9-dc77f787468b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:00.819709 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-72f7926e-f03a-4ab2-b7e9-dc77f787468b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:00.821740 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-72f7926e-f03a-4ab2-b7e9-dc77f787468b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:00.822889 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-72f7926e-f03a-4ab2-b7e9-dc77f787468b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1731 microversion: 2.20 time: 0.159511 Jan 05 15:06:00.823465 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 453/914] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:06:00 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:06:00.880545 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-92cbe96b-f5b9-49d9-8f35-2a05ef33701e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:00.887824 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-92cbe96b-f5b9-49d9-8f35-2a05ef33701e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1318 microversion: 2.1 time: 0.153562 Jan 05 15:06:00.888393 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 462/915] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:00 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:01.841289 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d241c83c-7746-4563-813e-8d8f3b37c395 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:01.841955 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d241c83c-7746-4563-813e-8d8f3b37c395 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:01.848787 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d241c83c-7746-4563-813e-8d8f3b37c395 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:01.849372 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d241c83c-7746-4563-813e-8d8f3b37c395 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:01.850150 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d241c83c-7746-4563-813e-8d8f3b37c395 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:01.850586 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d241c83c-7746-4563-813e-8d8f3b37c395 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:01.905144 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-929af0b4-3bd6-426e-a8d5-15baa1729316 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:01.905754 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-929af0b4-3bd6-426e-a8d5-15baa1729316 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:01.912087 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-929af0b4-3bd6-426e-a8d5-15baa1729316 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:01.912518 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-929af0b4-3bd6-426e-a8d5-15baa1729316 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:01.913328 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-929af0b4-3bd6-426e-a8d5-15baa1729316 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:01.913792 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-929af0b4-3bd6-426e-a8d5-15baa1729316 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:01.980436 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d241c83c-7746-4563-813e-8d8f3b37c395 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:01.988621 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d241c83c-7746-4563-813e-8d8f3b37c395 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:01.990156 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d241c83c-7746-4563-813e-8d8f3b37c395 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:01.991437 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d241c83c-7746-4563-813e-8d8f3b37c395 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1731 microversion: 2.20 time: 0.154269 Jan 05 15:06:01.991996 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 454/916] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:06:01 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:06:02.048045 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-929af0b4-3bd6-426e-a8d5-15baa1729316 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:02.055202 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-929af0b4-3bd6-426e-a8d5-15baa1729316 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1318 microversion: 2.1 time: 0.153768 Jan 05 15:06:02.056307 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 463/917] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:01 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:06:02.439985 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-c37c7a2c-b902-4372-af87-e3d8be1b6267 req-df78a62e-92b4-4ad4-9668-ab228a73b386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "name": "network-vif-plugged", "status": "completed", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:06:02.441931 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:02.441931 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:06:02.448857 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-c37c7a2c-b902-4372-af87-e3d8be1b6267 req-df78a62e-92b4-4ad4-9668-ab228a73b386 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:02.453390 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-c37c7a2c-b902-4372-af87-e3d8be1b6267 req-df78a62e-92b4-4ad4-9668-ab228a73b386 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:02.462408 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-c37c7a2c-b902-4372-af87-e3d8be1b6267 req-df78a62e-92b4-4ad4-9668-ab228a73b386 service nova] Creating event network-vif-plugged:0d57813b-5531-41c7-8d8d-8b2fc393b843 for instance a591f495-ff59-4865-87ea-c48041ea097f on hv-cinder-maste Jan 05 15:06:02.467407 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-c37c7a2c-b902-4372-af87-e3d8be1b6267 req-df78a62e-92b4-4ad4-9668-ab228a73b386 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031501 Jan 05 15:06:02.467995 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 455/918] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:06:03.010377 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3b21afeb-ede4-4a1f-9df5-e4c679b3daa8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:03.010983 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3b21afeb-ede4-4a1f-9df5-e4c679b3daa8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:03.017156 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b21afeb-ede4-4a1f-9df5-e4c679b3daa8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:03.017599 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b21afeb-ede4-4a1f-9df5-e4c679b3daa8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:03.018365 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b21afeb-ede4-4a1f-9df5-e4c679b3daa8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:03.018794 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b21afeb-ede4-4a1f-9df5-e4c679b3daa8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:03.072929 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c692210d-21f5-47b4-a27f-2e2f588880e5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:03.073662 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c692210d-21f5-47b4-a27f-2e2f588880e5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:03.079661 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c692210d-21f5-47b4-a27f-2e2f588880e5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:03.080115 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c692210d-21f5-47b4-a27f-2e2f588880e5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:03.080899 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c692210d-21f5-47b4-a27f-2e2f588880e5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:03.081359 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c692210d-21f5-47b4-a27f-2e2f588880e5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:03.154154 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3b21afeb-ede4-4a1f-9df5-e4c679b3daa8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:03.161673 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3b21afeb-ede4-4a1f-9df5-e4c679b3daa8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:03.163196 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3b21afeb-ede4-4a1f-9df5-e4c679b3daa8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:03.164356 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3b21afeb-ede4-4a1f-9df5-e4c679b3daa8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1731 microversion: 2.20 time: 0.158239 Jan 05 15:06:03.164926 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 464/919] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:06:03 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:06:03.215850 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c692210d-21f5-47b4-a27f-2e2f588880e5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:03.222997 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c692210d-21f5-47b4-a27f-2e2f588880e5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1318 microversion: 2.1 time: 0.155078 Jan 05 15:06:03.223563 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 456/920] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:03 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:06:04.182185 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-839772d6-7904-4e0f-abdf-8658793afcb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:04.182794 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-839772d6-7904-4e0f-abdf-8658793afcb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:04.190983 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-839772d6-7904-4e0f-abdf-8658793afcb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:04.190983 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-839772d6-7904-4e0f-abdf-8658793afcb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:04.190983 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-839772d6-7904-4e0f-abdf-8658793afcb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:04.190983 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-839772d6-7904-4e0f-abdf-8658793afcb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:04.241803 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-99a5bf78-9e2f-4e36-83eb-2fc72fc981ac tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:04.242410 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-99a5bf78-9e2f-4e36-83eb-2fc72fc981ac tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:04.248877 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-99a5bf78-9e2f-4e36-83eb-2fc72fc981ac tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:04.249349 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-99a5bf78-9e2f-4e36-83eb-2fc72fc981ac tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:04.250126 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-99a5bf78-9e2f-4e36-83eb-2fc72fc981ac tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:04.250556 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-99a5bf78-9e2f-4e36-83eb-2fc72fc981ac tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:04.330392 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-839772d6-7904-4e0f-abdf-8658793afcb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:04.339188 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-839772d6-7904-4e0f-abdf-8658793afcb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:04.341238 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-839772d6-7904-4e0f-abdf-8658793afcb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:04.342642 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-839772d6-7904-4e0f-abdf-8658793afcb7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1731 microversion: 2.20 time: 0.164184 Jan 05 15:06:04.343203 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 465/921] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:06:04 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:06:04.396960 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-99a5bf78-9e2f-4e36-83eb-2fc72fc981ac tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:04.404418 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-99a5bf78-9e2f-4e36-83eb-2fc72fc981ac tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1318 microversion: 2.1 time: 0.166261 Jan 05 15:06:04.405015 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 457/922] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:04 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:06:05.360788 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e6ded08b-386f-496e-bdc8-3859ae855e65 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:05.361384 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e6ded08b-386f-496e-bdc8-3859ae855e65 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:05.367735 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6ded08b-386f-496e-bdc8-3859ae855e65 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:05.368776 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6ded08b-386f-496e-bdc8-3859ae855e65 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:05.369586 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6ded08b-386f-496e-bdc8-3859ae855e65 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:05.370020 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6ded08b-386f-496e-bdc8-3859ae855e65 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:05.421315 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f6a0ca7d-692c-46f4-b5b2-23c9946ee369 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:05.422721 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f6a0ca7d-692c-46f4-b5b2-23c9946ee369 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:05.428213 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f6a0ca7d-692c-46f4-b5b2-23c9946ee369 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:05.428665 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f6a0ca7d-692c-46f4-b5b2-23c9946ee369 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:05.429474 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f6a0ca7d-692c-46f4-b5b2-23c9946ee369 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:05.429913 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f6a0ca7d-692c-46f4-b5b2-23c9946ee369 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:05.504513 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e6ded08b-386f-496e-bdc8-3859ae855e65 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:05.517478 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e6ded08b-386f-496e-bdc8-3859ae855e65 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:05.519057 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e6ded08b-386f-496e-bdc8-3859ae855e65 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:05.520215 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e6ded08b-386f-496e-bdc8-3859ae855e65 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1731 microversion: 2.20 time: 0.163253 Jan 05 15:06:05.520775 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 466/923] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:06:05 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:06:05.580396 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f6a0ca7d-692c-46f4-b5b2-23c9946ee369 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:05.588499 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f6a0ca7d-692c-46f4-b5b2-23c9946ee369 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1318 microversion: 2.1 time: 0.170872 Jan 05 15:06:05.589092 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 458/924] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:05 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:06:06.542648 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a8d2d7bc-3cd5-41ae-a7b1-d45856cbe82b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:06.543259 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a8d2d7bc-3cd5-41ae-a7b1-d45856cbe82b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:06.549755 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8d2d7bc-3cd5-41ae-a7b1-d45856cbe82b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:06.552787 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8d2d7bc-3cd5-41ae-a7b1-d45856cbe82b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:06.552787 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8d2d7bc-3cd5-41ae-a7b1-d45856cbe82b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:06.552787 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8d2d7bc-3cd5-41ae-a7b1-d45856cbe82b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:06.566649 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-05ebaf86-a5e4-472d-9b83-fbb663719520 req-ead70de7-0d7f-4ee8-be3b-9ad93003c6cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c16547ce-867c-46c9-9117-9a3ff7f2b0e9", "name": "network-vif-plugged", "status": "completed", "tag": "906a8d4e-ebf8-4e84-9c63-6111c3e36d6b"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:06:06.568280 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:06.568280 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:06:06.576077 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-05ebaf86-a5e4-472d-9b83-fbb663719520 req-ead70de7-0d7f-4ee8-be3b-9ad93003c6cc service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:06.576521 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-05ebaf86-a5e4-472d-9b83-fbb663719520 req-ead70de7-0d7f-4ee8-be3b-9ad93003c6cc service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:06.587402 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-05ebaf86-a5e4-472d-9b83-fbb663719520 req-ead70de7-0d7f-4ee8-be3b-9ad93003c6cc service nova] Creating event network-vif-plugged:906a8d4e-ebf8-4e84-9c63-6111c3e36d6b for instance c16547ce-867c-46c9-9117-9a3ff7f2b0e9 on hv-cinder-maste Jan 05 15:06:06.592158 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-05ebaf86-a5e4-472d-9b83-fbb663719520 req-ead70de7-0d7f-4ee8-be3b-9ad93003c6cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029361 Jan 05 15:06:06.592986 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 459/925] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:06:06.606153 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c58922b5-e4a6-47f7-9d0a-77a7b2a50968 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:06.606852 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c58922b5-e4a6-47f7-9d0a-77a7b2a50968 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:06.612914 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c58922b5-e4a6-47f7-9d0a-77a7b2a50968 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:06.613403 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c58922b5-e4a6-47f7-9d0a-77a7b2a50968 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:06.614178 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c58922b5-e4a6-47f7-9d0a-77a7b2a50968 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:06.614614 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c58922b5-e4a6-47f7-9d0a-77a7b2a50968 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:06.707407 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a8d2d7bc-3cd5-41ae-a7b1-d45856cbe82b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:06.715455 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a8d2d7bc-3cd5-41ae-a7b1-d45856cbe82b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:06.716967 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a8d2d7bc-3cd5-41ae-a7b1-d45856cbe82b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:06.718259 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a8d2d7bc-3cd5-41ae-a7b1-d45856cbe82b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1718 microversion: 2.20 time: 0.179889 Jan 05 15:06:06.721648 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 467/926] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:06:06 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1718 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:06:06.766867 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c58922b5-e4a6-47f7-9d0a-77a7b2a50968 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:06.775177 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c58922b5-e4a6-47f7-9d0a-77a7b2a50968 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1318 microversion: 2.1 time: 0.173828 Jan 05 15:06:06.775749 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 460/927] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:06 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:06:07.460510 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d832d6f1-308d-4584-8b8e-19958af83c13 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:06:07.461033 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d832d6f1-308d-4584-8b8e-19958af83c13 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:07.466981 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d832d6f1-308d-4584-8b8e-19958af83c13 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:07.467427 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d832d6f1-308d-4584-8b8e-19958af83c13 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:07.468192 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d832d6f1-308d-4584-8b8e-19958af83c13 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:07.468618 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d832d6f1-308d-4584-8b8e-19958af83c13 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:07.490901 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-d832d6f1-308d-4584-8b8e-19958af83c13 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lazy-loading 'flavor' on Instance uuid 61994ccf-e8cd-41a1-aad1-c56ee0edd0af {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:06:07.792059 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c4b65224-af99-4cb5-91f4-7815e1627d4b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:07.792593 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c4b65224-af99-4cb5-91f4-7815e1627d4b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:07.798704 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c4b65224-af99-4cb5-91f4-7815e1627d4b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:07.799142 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c4b65224-af99-4cb5-91f4-7815e1627d4b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:07.799907 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c4b65224-af99-4cb5-91f4-7815e1627d4b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:07.800333 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c4b65224-af99-4cb5-91f4-7815e1627d4b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:07.932400 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c4b65224-af99-4cb5-91f4-7815e1627d4b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:07.939818 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c4b65224-af99-4cb5-91f4-7815e1627d4b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1318 microversion: 2.1 time: 0.152060 Jan 05 15:06:07.940385 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 461/928] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:07 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:06:07.951950 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d832d6f1-308d-4584-8b8e-19958af83c13 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "POST /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af/action" status: 202 len: 0 microversion: 2.1 time: 0.494962 Jan 05 15:06:07.952543 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 468/929] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:06:07 2022] POST /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:06:07.960287 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d7774f38-2ee8-480c-bda2-2bbeebfab91b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:07.960921 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d7774f38-2ee8-480c-bda2-2bbeebfab91b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:07.967310 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d7774f38-2ee8-480c-bda2-2bbeebfab91b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:07.967750 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d7774f38-2ee8-480c-bda2-2bbeebfab91b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:07.968522 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d7774f38-2ee8-480c-bda2-2bbeebfab91b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:07.968948 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d7774f38-2ee8-480c-bda2-2bbeebfab91b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:08.104693 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d7774f38-2ee8-480c-bda2-2bbeebfab91b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:08.112060 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d7774f38-2ee8-480c-bda2-2bbeebfab91b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1567 microversion: 2.1 time: 0.155262 Jan 05 15:06:08.112634 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 462/930] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:07 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:08.956806 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6e830d7d-f97f-426e-b6e5-c2831d7a15cb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:08.957551 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6e830d7d-f97f-426e-b6e5-c2831d7a15cb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:08.963951 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e830d7d-f97f-426e-b6e5-c2831d7a15cb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:08.964394 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e830d7d-f97f-426e-b6e5-c2831d7a15cb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:08.965200 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e830d7d-f97f-426e-b6e5-c2831d7a15cb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:08.965641 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e830d7d-f97f-426e-b6e5-c2831d7a15cb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:09.099077 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6e830d7d-f97f-426e-b6e5-c2831d7a15cb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:09.106110 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6e830d7d-f97f-426e-b6e5-c2831d7a15cb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1507 microversion: 2.1 time: 0.153396 Jan 05 15:06:09.106676 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 469/931] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:08 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:09.129683 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-8f307822-b48e-4fa9-836c-1c84e6584990 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:09.130247 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-8f307822-b48e-4fa9-836c-1c84e6584990 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:09.136756 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8f307822-b48e-4fa9-836c-1c84e6584990 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:09.137292 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8f307822-b48e-4fa9-836c-1c84e6584990 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:09.138080 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8f307822-b48e-4fa9-836c-1c84e6584990 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:09.138514 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8f307822-b48e-4fa9-836c-1c84e6584990 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:09.268447 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-8f307822-b48e-4fa9-836c-1c84e6584990 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:09.276251 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-8f307822-b48e-4fa9-836c-1c84e6584990 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1567 microversion: 2.1 time: 0.150613 Jan 05 15:06:09.276817 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 463/932] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:09 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:10.293188 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4cf628fc-9d82-4cbf-9a95-876cd2620bfb tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:10.293800 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4cf628fc-9d82-4cbf-9a95-876cd2620bfb tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:10.299995 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cf628fc-9d82-4cbf-9a95-876cd2620bfb tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:10.300448 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cf628fc-9d82-4cbf-9a95-876cd2620bfb tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:10.301258 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cf628fc-9d82-4cbf-9a95-876cd2620bfb tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:10.301694 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cf628fc-9d82-4cbf-9a95-876cd2620bfb tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:10.435329 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4cf628fc-9d82-4cbf-9a95-876cd2620bfb tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:10.441109 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4cf628fc-9d82-4cbf-9a95-876cd2620bfb tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1567 microversion: 2.1 time: 0.151737 Jan 05 15:06:10.441748 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 470/933] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:10 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:11.458265 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-cab0a98e-df15-4c65-b393-eadbc439e192 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:11.458874 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-cab0a98e-df15-4c65-b393-eadbc439e192 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:11.465793 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cab0a98e-df15-4c65-b393-eadbc439e192 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:11.466237 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cab0a98e-df15-4c65-b393-eadbc439e192 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:11.467009 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cab0a98e-df15-4c65-b393-eadbc439e192 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:11.467438 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-cab0a98e-df15-4c65-b393-eadbc439e192 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:11.597613 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-cab0a98e-df15-4c65-b393-eadbc439e192 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:11.605259 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-cab0a98e-df15-4c65-b393-eadbc439e192 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1567 microversion: 2.1 time: 0.150678 Jan 05 15:06:11.605821 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 464/934] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:11 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:12.023262 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-627ac886-0581-4e33-ad5c-4bddd139e37c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f9b1946-7928-4ffa-8ce1-58b94dadf7b4"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:06:12.024409 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-627ac886-0581-4e33-ad5c-4bddd139e37c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:12.030924 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-627ac886-0581-4e33-ad5c-4bddd139e37c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:12.031371 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-627ac886-0581-4e33-ad5c-4bddd139e37c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:12.032186 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-627ac886-0581-4e33-ad5c-4bddd139e37c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:12.032621 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-627ac886-0581-4e33-ad5c-4bddd139e37c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:12.621630 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-5884b1f6-95f5-4152-a82a-2200a546da44 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:12.622427 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-5884b1f6-95f5-4152-a82a-2200a546da44 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:12.629004 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5884b1f6-95f5-4152-a82a-2200a546da44 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:12.629501 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5884b1f6-95f5-4152-a82a-2200a546da44 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:12.630364 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5884b1f6-95f5-4152-a82a-2200a546da44 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:12.630802 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5884b1f6-95f5-4152-a82a-2200a546da44 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:12.766650 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-5884b1f6-95f5-4152-a82a-2200a546da44 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:12.774174 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-5884b1f6-95f5-4152-a82a-2200a546da44 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1567 microversion: 2.1 time: 0.156214 Jan 05 15:06:12.774744 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 465/935] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:12 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:06:12.951569 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-627ac886-0581-4e33-ad5c-4bddd139e37c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "POST /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.931832 Jan 05 15:06:12.952177 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 471/936] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Jan 5 15:06:12 2022] POST /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9/os-volume_attachments => generated 194 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:06:13.791199 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-820810f6-e977-4a5b-8e0b-7e5d39bd011f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:13.791752 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-820810f6-e977-4a5b-8e0b-7e5d39bd011f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:13.797602 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-820810f6-e977-4a5b-8e0b-7e5d39bd011f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:13.798053 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-820810f6-e977-4a5b-8e0b-7e5d39bd011f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:13.798822 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-820810f6-e977-4a5b-8e0b-7e5d39bd011f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:13.799254 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-820810f6-e977-4a5b-8e0b-7e5d39bd011f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:13.926155 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-820810f6-e977-4a5b-8e0b-7e5d39bd011f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:13.934139 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-820810f6-e977-4a5b-8e0b-7e5d39bd011f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1567 microversion: 2.1 time: 0.147180 Jan 05 15:06:13.937847 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 466/937] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:13 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:14.951926 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6abafdb7-2e17-4360-a54d-988da781e38b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:14.952626 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6abafdb7-2e17-4360-a54d-988da781e38b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:14.959043 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6abafdb7-2e17-4360-a54d-988da781e38b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:14.959484 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6abafdb7-2e17-4360-a54d-988da781e38b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:14.960248 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6abafdb7-2e17-4360-a54d-988da781e38b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:14.960672 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6abafdb7-2e17-4360-a54d-988da781e38b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:15.097165 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6abafdb7-2e17-4360-a54d-988da781e38b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:15.101198 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6abafdb7-2e17-4360-a54d-988da781e38b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1567 microversion: 2.1 time: 0.153794 Jan 05 15:06:15.101749 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 472/938] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:14 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:16.117862 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-8b60c314-dcca-4baa-be5c-1669bbb52489 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:16.118480 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-8b60c314-dcca-4baa-be5c-1669bbb52489 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:16.124853 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8b60c314-dcca-4baa-be5c-1669bbb52489 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:16.125332 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8b60c314-dcca-4baa-be5c-1669bbb52489 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:16.126119 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8b60c314-dcca-4baa-be5c-1669bbb52489 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:16.126553 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8b60c314-dcca-4baa-be5c-1669bbb52489 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:16.256566 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-8b60c314-dcca-4baa-be5c-1669bbb52489 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:16.264351 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-8b60c314-dcca-4baa-be5c-1669bbb52489 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1567 microversion: 2.1 time: 0.150190 Jan 05 15:06:16.264918 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 467/939] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:16 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:17.280840 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a971bafd-9db4-4592-a3f2-cd649b4504bc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:17.281479 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a971bafd-9db4-4592-a3f2-cd649b4504bc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:17.287739 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a971bafd-9db4-4592-a3f2-cd649b4504bc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:17.288211 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a971bafd-9db4-4592-a3f2-cd649b4504bc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:17.288991 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a971bafd-9db4-4592-a3f2-cd649b4504bc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:17.289454 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a971bafd-9db4-4592-a3f2-cd649b4504bc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:17.416481 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a971bafd-9db4-4592-a3f2-cd649b4504bc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:17.424324 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a971bafd-9db4-4592-a3f2-cd649b4504bc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1567 microversion: 2.1 time: 0.147112 Jan 05 15:06:17.424893 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 473/940] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:17 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:18.441661 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6fce71b1-f5d3-48c0-bfa9-7e72a84fa2ce tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:18.442268 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-6fce71b1-f5d3-48c0-bfa9-7e72a84fa2ce tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:18.448594 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6fce71b1-f5d3-48c0-bfa9-7e72a84fa2ce tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:18.449050 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6fce71b1-f5d3-48c0-bfa9-7e72a84fa2ce tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:18.449924 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6fce71b1-f5d3-48c0-bfa9-7e72a84fa2ce tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:18.450363 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6fce71b1-f5d3-48c0-bfa9-7e72a84fa2ce tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:18.582120 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-6fce71b1-f5d3-48c0-bfa9-7e72a84fa2ce tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:18.590126 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6fce71b1-f5d3-48c0-bfa9-7e72a84fa2ce tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1567 microversion: 2.1 time: 0.152174 Jan 05 15:06:18.590815 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 468/941] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:18 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:19.606277 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9647fb4f-85dd-406b-bbac-149945079ebd tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:19.606881 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9647fb4f-85dd-406b-bbac-149945079ebd tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:19.613190 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9647fb4f-85dd-406b-bbac-149945079ebd tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:19.613636 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9647fb4f-85dd-406b-bbac-149945079ebd tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:19.614516 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9647fb4f-85dd-406b-bbac-149945079ebd tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:19.614838 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9647fb4f-85dd-406b-bbac-149945079ebd tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:19.748495 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-9647fb4f-85dd-406b-bbac-149945079ebd tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:19.755824 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9647fb4f-85dd-406b-bbac-149945079ebd tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1567 microversion: 2.1 time: 0.153387 Jan 05 15:06:19.756390 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 474/942] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:19 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:20.437963 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-0f954d18-1e99-4702-bc75-18d81544f6c1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1341374808", "imageRef": "e4c11159-1e41-437a-af97-eb5f10704ae6", "flavorRef": "452", "networks": [{"uuid": "15d9f439-989e-49bd-a540-259f7f374d29"}]}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:06:20.489796 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.network.neutron [None req-0f954d18-1e99-4702-bc75-18d81544f6c1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] validate_networks() for [('15d9f439-989e-49bd-a540-259f7f374d29', None, None, None, None, None)] {{(pid=128789) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 15:06:20.774034 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-edf3ab05-4a8f-405e-9be2-0b54315ff9a2 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:20.774730 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-edf3ab05-4a8f-405e-9be2-0b54315ff9a2 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:20.781827 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edf3ab05-4a8f-405e-9be2-0b54315ff9a2 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:20.782316 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edf3ab05-4a8f-405e-9be2-0b54315ff9a2 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:20.783313 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edf3ab05-4a8f-405e-9be2-0b54315ff9a2 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:20.783748 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edf3ab05-4a8f-405e-9be2-0b54315ff9a2 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:20.929315 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-edf3ab05-4a8f-405e-9be2-0b54315ff9a2 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:20.937737 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-edf3ab05-4a8f-405e-9be2-0b54315ff9a2 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1567 microversion: 2.1 time: 0.168540 Jan 05 15:06:20.938330 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 475/943] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:20 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:06:21.087268 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-0f954d18-1e99-4702-bc75-18d81544f6c1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Flavor limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 15:06:21.087714 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-0f954d18-1e99-4702-bc75-18d81544f6c1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Image limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 15:06:21.088178 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-0f954d18-1e99-4702-bc75-18d81544f6c1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Flavor pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 15:06:21.088579 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-0f954d18-1e99-4702-bc75-18d81544f6c1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Image pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 15:06:21.089041 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-0f954d18-1e99-4702-bc75-18d81544f6c1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 15:06:21.097831 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0f954d18-1e99-4702-bc75-18d81544f6c1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:21.098270 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0f954d18-1e99-4702-bc75-18d81544f6c1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:21.099070 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0f954d18-1e99-4702-bc75-18d81544f6c1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:21.099498 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0f954d18-1e99-4702-bc75-18d81544f6c1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:21.119965 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-0f954d18-1e99-4702-bc75-18d81544f6c1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Getting quotas for project 97821d0c0c79446abba323f103c8244a. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:06:21.124478 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-0f954d18-1e99-4702-bc75-18d81544f6c1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Getting quotas for user e1578e40c006442ca632381e242d35bf and project 97821d0c0c79446abba323f103c8244a. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:06:21.141224 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0f954d18-1e99-4702-bc75-18d81544f6c1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Going to run 1 instances... {{(pid=128789) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 15:06:21.143564 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0f954d18-1e99-4702-bc75-18d81544f6c1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4c11159-1e41-437a-af97-eb5f10704ae6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 15:06:21.245904 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-0f954d18-1e99-4702-bc75-18d81544f6c1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810887 Jan 05 15:06:21.246587 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 469/944] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 15:06:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 15:06:21.256195 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f6ab5e47-3023-4290-8e36-1b3fc4d3ea9a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:21.256803 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f6ab5e47-3023-4290-8e36-1b3fc4d3ea9a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:21.308606 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-f6ab5e47-3023-4290-8e36-1b3fc4d3ea9a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:21.315037 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f6ab5e47-3023-4290-8e36-1b3fc4d3ea9a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 200 len: 1218 microversion: 2.1 time: 0.062495 Jan 05 15:06:21.315695 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 476/945] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:21 2022] GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:21.955946 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e646c7ae-4467-4d92-a546-5d33f2e94cfc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:21.956493 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e646c7ae-4467-4d92-a546-5d33f2e94cfc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:21.965898 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e646c7ae-4467-4d92-a546-5d33f2e94cfc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:21.966370 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e646c7ae-4467-4d92-a546-5d33f2e94cfc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:21.967193 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e646c7ae-4467-4d92-a546-5d33f2e94cfc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:21.967643 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e646c7ae-4467-4d92-a546-5d33f2e94cfc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:22.101616 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e646c7ae-4467-4d92-a546-5d33f2e94cfc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:22.106655 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e646c7ae-4467-4d92-a546-5d33f2e94cfc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1568 microversion: 2.1 time: 0.154945 Jan 05 15:06:22.107209 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 470/946] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:21 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:22.123016 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-883fd817-7f22-41ad-9516-37b8e9cc195d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:06:22.123579 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-883fd817-7f22-41ad-9516-37b8e9cc195d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:22.129850 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-883fd817-7f22-41ad-9516-37b8e9cc195d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:22.130297 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-883fd817-7f22-41ad-9516-37b8e9cc195d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:22.131079 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-883fd817-7f22-41ad-9516-37b8e9cc195d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:22.131507 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-883fd817-7f22-41ad-9516-37b8e9cc195d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:22.331478 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-20500766-9821-4442-8d7d-4afb8db760b1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:22.332118 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-20500766-9821-4442-8d7d-4afb8db760b1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:22.337968 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-20500766-9821-4442-8d7d-4afb8db760b1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:22.338430 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-20500766-9821-4442-8d7d-4afb8db760b1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:22.339178 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-20500766-9821-4442-8d7d-4afb8db760b1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:22.339603 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-20500766-9821-4442-8d7d-4afb8db760b1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:22.397252 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-20500766-9821-4442-8d7d-4afb8db760b1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:22.404513 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-20500766-9821-4442-8d7d-4afb8db760b1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 200 len: 1222 microversion: 2.1 time: 0.076732 Jan 05 15:06:22.405085 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 471/947] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:22 2022] GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:06:22.457494 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-883fd817-7f22-41ad-9516-37b8e9cc195d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "POST /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af/action" status: 202 len: 0 microversion: 2.1 time: 0.338193 Jan 05 15:06:22.458106 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 477/948] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Jan 5 15:06:22 2022] POST /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:06:22.465896 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1c96640a-46f5-4c57-ae5d-3f50a2c1ab64 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:22.466494 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1c96640a-46f5-4c57-ae5d-3f50a2c1ab64 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:22.472307 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1c96640a-46f5-4c57-ae5d-3f50a2c1ab64 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:22.472768 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1c96640a-46f5-4c57-ae5d-3f50a2c1ab64 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:22.473549 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1c96640a-46f5-4c57-ae5d-3f50a2c1ab64 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:22.474168 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1c96640a-46f5-4c57-ae5d-3f50a2c1ab64 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:22.609847 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-1c96640a-46f5-4c57-ae5d-3f50a2c1ab64 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:22.617792 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1c96640a-46f5-4c57-ae5d-3f50a2c1ab64 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1516 microversion: 2.1 time: 0.155616 Jan 05 15:06:22.618614 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 472/949] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:22 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:23.421766 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-76b24617-bf81-4d73-a345-b8298f4cc94b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:23.422387 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-76b24617-bf81-4d73-a345-b8298f4cc94b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:23.428107 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b24617-bf81-4d73-a345-b8298f4cc94b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:23.428560 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b24617-bf81-4d73-a345-b8298f4cc94b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:23.429370 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b24617-bf81-4d73-a345-b8298f4cc94b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:23.429829 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b24617-bf81-4d73-a345-b8298f4cc94b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:23.508096 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-76b24617-bf81-4d73-a345-b8298f4cc94b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:23.517087 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-76b24617-bf81-4d73-a345-b8298f4cc94b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 200 len: 1278 microversion: 2.1 time: 0.099894 Jan 05 15:06:23.517708 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 478/950] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:23 2022] GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 1278 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:23.634342 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-12c50a06-5924-42f9-9744-5c2f5effd51b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:23.635002 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-12c50a06-5924-42f9-9744-5c2f5effd51b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:23.641786 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-12c50a06-5924-42f9-9744-5c2f5effd51b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:23.642316 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-12c50a06-5924-42f9-9744-5c2f5effd51b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:23.643224 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-12c50a06-5924-42f9-9744-5c2f5effd51b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:23.643721 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-12c50a06-5924-42f9-9744-5c2f5effd51b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:23.798026 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-12c50a06-5924-42f9-9744-5c2f5effd51b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:23.807562 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-12c50a06-5924-42f9-9744-5c2f5effd51b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1518 microversion: 2.1 time: 0.176743 Jan 05 15:06:23.808337 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 473/951] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:23 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:24.534083 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-da978480-5a07-49fa-85df-000f0c2ddac4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:24.534857 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-da978480-5a07-49fa-85df-000f0c2ddac4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:24.542489 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da978480-5a07-49fa-85df-000f0c2ddac4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:24.543547 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da978480-5a07-49fa-85df-000f0c2ddac4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:24.544424 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da978480-5a07-49fa-85df-000f0c2ddac4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:24.544935 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da978480-5a07-49fa-85df-000f0c2ddac4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:24.654131 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-e6ee5577-46b8-422e-8d74-44cfc938cc2b req-1fd6d3a2-ad5a-41d2-9fa4-465c0324667e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "name": "network-vif-unplugged", "status": "completed", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:06:24.656340 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:24.656340 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:06:24.663391 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-e6ee5577-46b8-422e-8d74-44cfc938cc2b req-1fd6d3a2-ad5a-41d2-9fa4-465c0324667e service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:24.663834 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-e6ee5577-46b8-422e-8d74-44cfc938cc2b req-1fd6d3a2-ad5a-41d2-9fa4-465c0324667e service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:24.674988 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.compute.server_external_events [req-e6ee5577-46b8-422e-8d74-44cfc938cc2b req-1fd6d3a2-ad5a-41d2-9fa4-465c0324667e service nova] Unable to find a host for instance 61994ccf-e8cd-41a1-aad1-c56ee0edd0af. Dropping event network-vif-unplugged {{(pid=128789) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 05 15:06:24.675866 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-e6ee5577-46b8-422e-8d74-44cfc938cc2b req-1fd6d3a2-ad5a-41d2-9fa4-465c0324667e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025537 Jan 05 15:06:24.676446 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 474/952] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 05 15:06:24.759463 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-da978480-5a07-49fa-85df-000f0c2ddac4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:24.767100 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-da978480-5a07-49fa-85df-000f0c2ddac4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 200 len: 1318 microversion: 2.1 time: 0.236862 Jan 05 15:06:24.768980 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 479/953] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:24 2022] GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:24.827680 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-04b68d64-6356-427d-9a6d-3e09030a543c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:24.828365 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-04b68d64-6356-427d-9a6d-3e09030a543c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:24.834949 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-04b68d64-6356-427d-9a6d-3e09030a543c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:24.835480 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-04b68d64-6356-427d-9a6d-3e09030a543c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:24.836344 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-04b68d64-6356-427d-9a6d-3e09030a543c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:24.836879 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-04b68d64-6356-427d-9a6d-3e09030a543c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:24.972836 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-04b68d64-6356-427d-9a6d-3e09030a543c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:24.981211 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-04b68d64-6356-427d-9a6d-3e09030a543c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1518 microversion: 2.1 time: 0.157354 Jan 05 15:06:24.981777 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 475/954] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:24 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:25.134041 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-d310c84e-2dcd-4e9f-9dca-481d803630c0 req-920a5b8c-4557-4036-b732-cc26ff4f8b13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3239a6e-4795-47bb-8958-e38b87a60e0e", "tag": "13cea986-c954-4f2a-80f4-f2a459e8a695"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:06:25.136884 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:25.136884 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:06:25.150831 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d310c84e-2dcd-4e9f-9dca-481d803630c0 req-920a5b8c-4557-4036-b732-cc26ff4f8b13 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:25.151270 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d310c84e-2dcd-4e9f-9dca-481d803630c0 req-920a5b8c-4557-4036-b732-cc26ff4f8b13 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:25.162962 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-d310c84e-2dcd-4e9f-9dca-481d803630c0 req-920a5b8c-4557-4036-b732-cc26ff4f8b13 service nova] Creating event network-changed:13cea986-c954-4f2a-80f4-f2a459e8a695 for instance e3239a6e-4795-47bb-8958-e38b87a60e0e on hv-cinder-maste Jan 05 15:06:25.167756 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-d310c84e-2dcd-4e9f-9dca-481d803630c0 req-920a5b8c-4557-4036-b732-cc26ff4f8b13 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037508 Jan 05 15:06:25.168353 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 480/955] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:06:25.785564 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b13577ad-d96a-431c-b0bb-b274b7e39f33 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:25.786171 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b13577ad-d96a-431c-b0bb-b274b7e39f33 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:25.793196 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b13577ad-d96a-431c-b0bb-b274b7e39f33 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:25.793644 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b13577ad-d96a-431c-b0bb-b274b7e39f33 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:25.794445 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b13577ad-d96a-431c-b0bb-b274b7e39f33 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:25.794882 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b13577ad-d96a-431c-b0bb-b274b7e39f33 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:25.926932 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b13577ad-d96a-431c-b0bb-b274b7e39f33 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:25.935173 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b13577ad-d96a-431c-b0bb-b274b7e39f33 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 200 len: 1318 microversion: 2.1 time: 0.153203 Jan 05 15:06:25.935769 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 476/956] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:25 2022] GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:25.999740 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-61596098-02ec-4ed8-b579-63d16df32661 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:26.000468 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-61596098-02ec-4ed8-b579-63d16df32661 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:26.006933 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61596098-02ec-4ed8-b579-63d16df32661 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:26.007472 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61596098-02ec-4ed8-b579-63d16df32661 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:26.008338 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61596098-02ec-4ed8-b579-63d16df32661 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:26.008844 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61596098-02ec-4ed8-b579-63d16df32661 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:26.384087 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-61596098-02ec-4ed8-b579-63d16df32661 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:26.391459 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-61596098-02ec-4ed8-b579-63d16df32661 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1574 microversion: 2.1 time: 0.397027 Jan 05 15:06:26.392145 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 481/957] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:25 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1574 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:26.952828 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-8a68a548-b7fc-48aa-8549-76624a6b544b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:26.953551 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-8a68a548-b7fc-48aa-8549-76624a6b544b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:26.960289 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8a68a548-b7fc-48aa-8549-76624a6b544b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:26.960672 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8a68a548-b7fc-48aa-8549-76624a6b544b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:26.961656 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8a68a548-b7fc-48aa-8549-76624a6b544b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:26.962084 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8a68a548-b7fc-48aa-8549-76624a6b544b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:27.093009 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-8a68a548-b7fc-48aa-8549-76624a6b544b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:27.100375 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-8a68a548-b7fc-48aa-8549-76624a6b544b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 200 len: 1318 microversion: 2.1 time: 0.152318 Jan 05 15:06:27.100941 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 477/958] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:26 2022] GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:27.408079 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-50ef2d78-cf03-4a4c-bb2f-d0a138b24f8c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:27.408685 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-50ef2d78-cf03-4a4c-bb2f-d0a138b24f8c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:27.414917 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ef2d78-cf03-4a4c-bb2f-d0a138b24f8c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:27.415355 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ef2d78-cf03-4a4c-bb2f-d0a138b24f8c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:27.416120 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ef2d78-cf03-4a4c-bb2f-d0a138b24f8c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:27.416580 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ef2d78-cf03-4a4c-bb2f-d0a138b24f8c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:27.549902 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-50ef2d78-cf03-4a4c-bb2f-d0a138b24f8c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:27.557328 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-50ef2d78-cf03-4a4c-bb2f-d0a138b24f8c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1574 microversion: 2.1 time: 0.152912 Jan 05 15:06:27.557895 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 482/959] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:27 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:28.116776 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-96f31985-114f-4dde-979a-f928cc9821c9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:28.117417 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-96f31985-114f-4dde-979a-f928cc9821c9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:28.123630 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96f31985-114f-4dde-979a-f928cc9821c9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:28.124077 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96f31985-114f-4dde-979a-f928cc9821c9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:28.124858 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96f31985-114f-4dde-979a-f928cc9821c9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:28.125331 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-96f31985-114f-4dde-979a-f928cc9821c9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:28.402613 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-96f31985-114f-4dde-979a-f928cc9821c9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:28.409876 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-96f31985-114f-4dde-979a-f928cc9821c9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 200 len: 1318 microversion: 2.1 time: 0.296746 Jan 05 15:06:28.410430 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 478/960] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:28 2022] GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:28.574409 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aaedb466-3bf2-4749-82f1-6c6c24018032 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:28.575025 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aaedb466-3bf2-4749-82f1-6c6c24018032 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:28.581294 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aaedb466-3bf2-4749-82f1-6c6c24018032 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:28.581742 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aaedb466-3bf2-4749-82f1-6c6c24018032 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:28.582510 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aaedb466-3bf2-4749-82f1-6c6c24018032 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:28.582942 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aaedb466-3bf2-4749-82f1-6c6c24018032 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:28.713780 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-aaedb466-3bf2-4749-82f1-6c6c24018032 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:28.721379 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aaedb466-3bf2-4749-82f1-6c6c24018032 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1574 microversion: 2.1 time: 0.151098 Jan 05 15:06:28.721950 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 483/961] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:28 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:29.426262 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e1be915f-ea79-43fd-947e-0643598fa05a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:29.426874 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e1be915f-ea79-43fd-947e-0643598fa05a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:29.433117 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e1be915f-ea79-43fd-947e-0643598fa05a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:29.433570 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e1be915f-ea79-43fd-947e-0643598fa05a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:29.434343 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e1be915f-ea79-43fd-947e-0643598fa05a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:29.434778 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e1be915f-ea79-43fd-947e-0643598fa05a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:29.562503 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e1be915f-ea79-43fd-947e-0643598fa05a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:29.569648 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e1be915f-ea79-43fd-947e-0643598fa05a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 200 len: 1318 microversion: 2.1 time: 0.147125 Jan 05 15:06:29.570202 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 479/962] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:29 2022] GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:29.739111 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-69629466-0ab5-40b3-806a-8eb2c27028ee tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:29.739660 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-69629466-0ab5-40b3-806a-8eb2c27028ee tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:29.745939 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69629466-0ab5-40b3-806a-8eb2c27028ee tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:29.746385 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69629466-0ab5-40b3-806a-8eb2c27028ee tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:29.747154 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69629466-0ab5-40b3-806a-8eb2c27028ee tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:29.747584 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69629466-0ab5-40b3-806a-8eb2c27028ee tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:29.882743 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-69629466-0ab5-40b3-806a-8eb2c27028ee tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:29.890618 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-69629466-0ab5-40b3-806a-8eb2c27028ee tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1574 microversion: 2.1 time: 0.155277 Jan 05 15:06:29.891185 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 484/963] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:29 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:30.586417 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1b31b081-5883-46f9-9cb8-f4266bd904b8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:30.587027 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1b31b081-5883-46f9-9cb8-f4266bd904b8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:30.593821 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1b31b081-5883-46f9-9cb8-f4266bd904b8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:30.594269 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1b31b081-5883-46f9-9cb8-f4266bd904b8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:30.595048 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1b31b081-5883-46f9-9cb8-f4266bd904b8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:30.595481 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1b31b081-5883-46f9-9cb8-f4266bd904b8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:30.725779 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-1b31b081-5883-46f9-9cb8-f4266bd904b8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:30.734198 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1b31b081-5883-46f9-9cb8-f4266bd904b8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 200 len: 1318 microversion: 2.1 time: 0.151317 Jan 05 15:06:30.735506 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 480/964] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:30 2022] GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:30.907727 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8ef5e32b-656c-470e-8a0c-4f189b137351 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:30.908271 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8ef5e32b-656c-470e-8a0c-4f189b137351 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:30.914583 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ef5e32b-656c-470e-8a0c-4f189b137351 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:30.915055 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ef5e32b-656c-470e-8a0c-4f189b137351 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:30.915825 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ef5e32b-656c-470e-8a0c-4f189b137351 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:30.916257 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ef5e32b-656c-470e-8a0c-4f189b137351 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:31.049580 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-8ef5e32b-656c-470e-8a0c-4f189b137351 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:31.057043 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8ef5e32b-656c-470e-8a0c-4f189b137351 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1574 microversion: 2.1 time: 0.153014 Jan 05 15:06:31.057641 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 485/965] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:30 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:31.752026 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-8eeef00e-b6d1-4baf-8aa5-9ab72af2328e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:31.752643 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-8eeef00e-b6d1-4baf-8aa5-9ab72af2328e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:31.758880 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8eeef00e-b6d1-4baf-8aa5-9ab72af2328e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:31.759320 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8eeef00e-b6d1-4baf-8aa5-9ab72af2328e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:31.760106 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8eeef00e-b6d1-4baf-8aa5-9ab72af2328e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:31.760542 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8eeef00e-b6d1-4baf-8aa5-9ab72af2328e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:31.885733 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-8eeef00e-b6d1-4baf-8aa5-9ab72af2328e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:31.892851 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-8eeef00e-b6d1-4baf-8aa5-9ab72af2328e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 200 len: 1318 microversion: 2.1 time: 0.144535 Jan 05 15:06:31.893428 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 481/966] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:31 2022] GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:32.074029 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b5935b77-75df-4dd9-9df9-201d0f04379e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:32.074637 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b5935b77-75df-4dd9-9df9-201d0f04379e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:32.080976 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5935b77-75df-4dd9-9df9-201d0f04379e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:32.081456 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5935b77-75df-4dd9-9df9-201d0f04379e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:32.082230 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5935b77-75df-4dd9-9df9-201d0f04379e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:32.082656 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5935b77-75df-4dd9-9df9-201d0f04379e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:32.211078 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b5935b77-75df-4dd9-9df9-201d0f04379e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:32.218956 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b5935b77-75df-4dd9-9df9-201d0f04379e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1574 microversion: 2.1 time: 0.148696 Jan 05 15:06:32.219510 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 486/967] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:32 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:32.665712 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-1a390db1-c161-4eed-9624-8fac206475c3 req-201cf43e-046d-461e-a79f-35d79143e423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3239a6e-4795-47bb-8958-e38b87a60e0e", "name": "network-vif-plugged", "status": "completed", "tag": "13cea986-c954-4f2a-80f4-f2a459e8a695"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:06:32.667327 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:32.667327 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:06:32.678080 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-1a390db1-c161-4eed-9624-8fac206475c3 req-201cf43e-046d-461e-a79f-35d79143e423 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:32.678080 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-1a390db1-c161-4eed-9624-8fac206475c3 req-201cf43e-046d-461e-a79f-35d79143e423 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:32.685937 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-1a390db1-c161-4eed-9624-8fac206475c3 req-201cf43e-046d-461e-a79f-35d79143e423 service nova] Creating event network-vif-plugged:13cea986-c954-4f2a-80f4-f2a459e8a695 for instance e3239a6e-4795-47bb-8958-e38b87a60e0e on hv-cinder-maste Jan 05 15:06:32.691020 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-1a390db1-c161-4eed-9624-8fac206475c3 req-201cf43e-046d-461e-a79f-35d79143e423 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028907 Jan 05 15:06:32.691612 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 482/968] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:06:32.909295 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d4539a11-51fb-49a7-bf56-d95d884da781 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:32.909900 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d4539a11-51fb-49a7-bf56-d95d884da781 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:32.915598 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4539a11-51fb-49a7-bf56-d95d884da781 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:32.916097 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4539a11-51fb-49a7-bf56-d95d884da781 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:32.916872 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4539a11-51fb-49a7-bf56-d95d884da781 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:32.917383 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4539a11-51fb-49a7-bf56-d95d884da781 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:33.050280 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d4539a11-51fb-49a7-bf56-d95d884da781 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:33.058254 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d4539a11-51fb-49a7-bf56-d95d884da781 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 200 len: 1318 microversion: 2.1 time: 0.152065 Jan 05 15:06:33.058832 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 487/969] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:32 2022] GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:33.235871 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-02095eef-0a6e-41b6-9ba8-3dd348fa0cc0 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:33.236574 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-02095eef-0a6e-41b6-9ba8-3dd348fa0cc0 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:33.243010 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-02095eef-0a6e-41b6-9ba8-3dd348fa0cc0 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:33.243461 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-02095eef-0a6e-41b6-9ba8-3dd348fa0cc0 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:33.244245 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-02095eef-0a6e-41b6-9ba8-3dd348fa0cc0 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:33.244681 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-02095eef-0a6e-41b6-9ba8-3dd348fa0cc0 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:33.376538 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-02095eef-0a6e-41b6-9ba8-3dd348fa0cc0 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:33.383901 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-02095eef-0a6e-41b6-9ba8-3dd348fa0cc0 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1574 microversion: 2.1 time: 0.151998 Jan 05 15:06:33.384464 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 483/970] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:33 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:34.074516 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1df1184e-c2c0-426d-af30-dfef022afa26 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:34.074975 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1df1184e-c2c0-426d-af30-dfef022afa26 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:34.080950 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1df1184e-c2c0-426d-af30-dfef022afa26 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:34.081436 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1df1184e-c2c0-426d-af30-dfef022afa26 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:34.082246 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1df1184e-c2c0-426d-af30-dfef022afa26 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:34.082677 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1df1184e-c2c0-426d-af30-dfef022afa26 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:34.216061 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1df1184e-c2c0-426d-af30-dfef022afa26 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:34.223261 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1df1184e-c2c0-426d-af30-dfef022afa26 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 200 len: 1318 microversion: 2.1 time: 0.153325 Jan 05 15:06:34.223825 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 488/971] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:34 2022] GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:34.401099 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-305495f0-e1a0-4884-bdf3-2ed7bb1d95bb tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:34.401703 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-305495f0-e1a0-4884-bdf3-2ed7bb1d95bb tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:34.407895 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-305495f0-e1a0-4884-bdf3-2ed7bb1d95bb tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:34.408347 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-305495f0-e1a0-4884-bdf3-2ed7bb1d95bb tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:34.409155 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-305495f0-e1a0-4884-bdf3-2ed7bb1d95bb tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:34.409599 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-305495f0-e1a0-4884-bdf3-2ed7bb1d95bb tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:34.543420 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-305495f0-e1a0-4884-bdf3-2ed7bb1d95bb tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:34.550792 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-305495f0-e1a0-4884-bdf3-2ed7bb1d95bb tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1574 microversion: 2.1 time: 0.153606 Jan 05 15:06:34.551351 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 484/972] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:34 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:35.239999 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b2fb331-427b-4b09-ad83-ae955f6a92b3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:35.240613 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5b2fb331-427b-4b09-ad83-ae955f6a92b3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:35.246949 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b2fb331-427b-4b09-ad83-ae955f6a92b3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:35.247398 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b2fb331-427b-4b09-ad83-ae955f6a92b3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:35.248176 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b2fb331-427b-4b09-ad83-ae955f6a92b3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:35.248610 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b2fb331-427b-4b09-ad83-ae955f6a92b3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:35.456429 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-5b2fb331-427b-4b09-ad83-ae955f6a92b3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:35.464263 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5b2fb331-427b-4b09-ad83-ae955f6a92b3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 200 len: 1507 microversion: 2.1 time: 0.227373 Jan 05 15:06:35.464845 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 489/973] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:35 2022] GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:35.480492 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6ba9b14a-7350-40f7-b854-77465d9d9ed6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f9b1946-7928-4ffa-8ce1-58b94dadf7b4"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:06:35.481576 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-6ba9b14a-7350-40f7-b854-77465d9d9ed6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:35.487914 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6ba9b14a-7350-40f7-b854-77465d9d9ed6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:35.488365 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6ba9b14a-7350-40f7-b854-77465d9d9ed6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:35.489206 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6ba9b14a-7350-40f7-b854-77465d9d9ed6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:35.489644 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6ba9b14a-7350-40f7-b854-77465d9d9ed6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:35.567129 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-6ba9b14a-7350-40f7-b854-77465d9d9ed6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] HTTP exception thrown: Invalid volume: volume 8f9b1946-7928-4ffa-8ce1-58b94dadf7b4 is already attached to instances: c16547ce-867c-46c9-9117-9a3ff7f2b0e9 Jan 05 15:06:35.567375 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6245799b-aa36-4345-a1a9-11720173c863 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:35.567739 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6ba9b14a-7350-40f7-b854-77465d9d9ed6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Returning 400 to user: Invalid volume: volume 8f9b1946-7928-4ffa-8ce1-58b94dadf7b4 is already attached to instances: c16547ce-867c-46c9-9117-9a3ff7f2b0e9 {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:06:35.567936 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6245799b-aa36-4345-a1a9-11720173c863 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:35.568559 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6ba9b14a-7350-40f7-b854-77465d9d9ed6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "POST /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092261 Jan 05 15:06:35.572395 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 485/974] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Jan 5 15:06:35 2022] POST /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 05 15:06:35.574486 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6245799b-aa36-4345-a1a9-11720173c863 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:35.574964 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6245799b-aa36-4345-a1a9-11720173c863 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:35.575754 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6245799b-aa36-4345-a1a9-11720173c863 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:35.576187 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6245799b-aa36-4345-a1a9-11720173c863 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:35.629794 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-591f5adf-5d27-48be-8dd0-d0853347a75c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:35.630290 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-591f5adf-5d27-48be-8dd0-d0853347a75c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:35.636629 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-591f5adf-5d27-48be-8dd0-d0853347a75c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:35.637096 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-591f5adf-5d27-48be-8dd0-d0853347a75c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:35.637872 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-591f5adf-5d27-48be-8dd0-d0853347a75c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:35.638300 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-591f5adf-5d27-48be-8dd0-d0853347a75c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:35.715853 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-591f5adf-5d27-48be-8dd0-d0853347a75c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lazy-loading 'services' on Instance uuid c16547ce-867c-46c9-9117-9a3ff7f2b0e9 {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:06:35.787103 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6245799b-aa36-4345-a1a9-11720173c863 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:35.794495 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6245799b-aa36-4345-a1a9-11720173c863 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1574 microversion: 2.1 time: 0.230794 Jan 05 15:06:35.795073 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 490/975] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:35 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1574 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:06:35.957501 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-591f5adf-5d27-48be-8dd0-d0853347a75c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9/os-volume_attachments/8f9b1946-7928-4ffa-8ce1-58b94dadf7b4" status: 202 len: 0 microversion: 2.1 time: 0.331229 Jan 05 15:06:35.958158 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 486/976] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Jan 5 15:06:35 2022] DELETE /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9/os-volume_attachments/8f9b1946-7928-4ffa-8ce1-58b94dadf7b4 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:06:35.966785 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa98bbd8-2515-4839-b076-0fc379786982 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:35.967774 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa98bbd8-2515-4839-b076-0fc379786982 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:35.973921 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa98bbd8-2515-4839-b076-0fc379786982 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:35.974366 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa98bbd8-2515-4839-b076-0fc379786982 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:35.975146 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa98bbd8-2515-4839-b076-0fc379786982 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:35.975572 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa98bbd8-2515-4839-b076-0fc379786982 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:36.004803 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aa98bbd8-2515-4839-b076-0fc379786982 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041855 Jan 05 15:06:36.005381 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 491/977] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:06:35 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:06:36.812080 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c2a41ae6-0adf-44d0-8300-f97c0d3a2b7b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:36.812775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c2a41ae6-0adf-44d0-8300-f97c0d3a2b7b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:36.818868 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c2a41ae6-0adf-44d0-8300-f97c0d3a2b7b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:36.819319 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c2a41ae6-0adf-44d0-8300-f97c0d3a2b7b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:36.820102 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c2a41ae6-0adf-44d0-8300-f97c0d3a2b7b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:36.820541 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c2a41ae6-0adf-44d0-8300-f97c0d3a2b7b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:36.951736 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c2a41ae6-0adf-44d0-8300-f97c0d3a2b7b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:36.959026 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c2a41ae6-0adf-44d0-8300-f97c0d3a2b7b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1574 microversion: 2.1 time: 0.151549 Jan 05 15:06:36.959593 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 487/978] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:36 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:37.017020 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ad7a02d8-10eb-42a9-a077-b1a93acb7f0e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:37.017928 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ad7a02d8-10eb-42a9-a077-b1a93acb7f0e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:37.027129 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad7a02d8-10eb-42a9-a077-b1a93acb7f0e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:37.029542 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad7a02d8-10eb-42a9-a077-b1a93acb7f0e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:37.029542 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad7a02d8-10eb-42a9-a077-b1a93acb7f0e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:37.029749 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad7a02d8-10eb-42a9-a077-b1a93acb7f0e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:37.071798 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ad7a02d8-10eb-42a9-a077-b1a93acb7f0e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058530 Jan 05 15:06:37.075019 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 492/979] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:06:37 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:06:37.976380 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7537ed17-2acd-4280-8244-54862bbab9ad tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:37.976987 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7537ed17-2acd-4280-8244-54862bbab9ad tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:37.984015 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7537ed17-2acd-4280-8244-54862bbab9ad tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:37.984516 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7537ed17-2acd-4280-8244-54862bbab9ad tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:37.985320 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7537ed17-2acd-4280-8244-54862bbab9ad tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:37.985753 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7537ed17-2acd-4280-8244-54862bbab9ad tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:38.083807 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b94b665-aca5-460a-ad0f-9d02907b1a3c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:38.087683 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5b94b665-aca5-460a-ad0f-9d02907b1a3c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:38.092005 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b94b665-aca5-460a-ad0f-9d02907b1a3c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:38.092523 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b94b665-aca5-460a-ad0f-9d02907b1a3c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:38.093415 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b94b665-aca5-460a-ad0f-9d02907b1a3c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:38.093911 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b94b665-aca5-460a-ad0f-9d02907b1a3c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:38.115042 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-7537ed17-2acd-4280-8244-54862bbab9ad tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:38.122733 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7537ed17-2acd-4280-8244-54862bbab9ad tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1574 microversion: 2.1 time: 0.150052 Jan 05 15:06:38.127782 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5b94b665-aca5-460a-ad0f-9d02907b1a3c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043257 Jan 05 15:06:38.127922 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 488/980] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:37 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:38.128037 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 493/981] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:06:38 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 05 15:06:38.226962 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-60e92945-4726-4674-99b4-086d530d99e8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1469439281", "imageRef": "e4c11159-1e41-437a-af97-eb5f10704ae6", "flavorRef": "452", "networks": [{"uuid": "15d9f439-989e-49bd-a540-259f7f374d29"}]}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:06:38.274808 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.network.neutron [None req-60e92945-4726-4674-99b4-086d530d99e8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] validate_networks() for [('15d9f439-989e-49bd-a540-259f7f374d29', None, None, None, None, None)] {{(pid=128789) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 15:06:38.623891 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-60e92945-4726-4674-99b4-086d530d99e8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Flavor limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 15:06:38.624409 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-60e92945-4726-4674-99b4-086d530d99e8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Image limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 15:06:38.624982 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-60e92945-4726-4674-99b4-086d530d99e8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Flavor pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 15:06:38.625512 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-60e92945-4726-4674-99b4-086d530d99e8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Image pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 15:06:38.626131 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-60e92945-4726-4674-99b4-086d530d99e8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 15:06:38.633441 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-0f906037-a45e-49b0-88a0-abab9b152d47 req-f0dee985-784e-4f69-ae9d-685545c3447a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "name": "network-vif-plugged", "status": "completed", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:06:38.635078 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:38.635078 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:06:38.642090 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0f906037-a45e-49b0-88a0-abab9b152d47 req-f0dee985-784e-4f69-ae9d-685545c3447a service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:38.642537 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0f906037-a45e-49b0-88a0-abab9b152d47 req-f0dee985-784e-4f69-ae9d-685545c3447a service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:38.645022 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-60e92945-4726-4674-99b4-086d530d99e8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:38.651276 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-60e92945-4726-4674-99b4-086d530d99e8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:38.651276 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-60e92945-4726-4674-99b4-086d530d99e8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:38.651276 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-60e92945-4726-4674-99b4-086d530d99e8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:38.653887 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-0f906037-a45e-49b0-88a0-abab9b152d47 req-f0dee985-784e-4f69-ae9d-685545c3447a service nova] Creating event network-vif-plugged:b7c14da5-847f-4d0d-9e0e-5c9ad34c581c for instance 61994ccf-e8cd-41a1-aad1-c56ee0edd0af on hv-cinder-maste Jan 05 15:06:38.659118 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-0f906037-a45e-49b0-88a0-abab9b152d47 req-f0dee985-784e-4f69-ae9d-685545c3447a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029230 Jan 05 15:06:38.659795 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 494/982] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:06:38.663753 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-60e92945-4726-4674-99b4-086d530d99e8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Getting quotas for project 97821d0c0c79446abba323f103c8244a. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:06:38.668239 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-60e92945-4726-4674-99b4-086d530d99e8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Getting quotas for user e1578e40c006442ca632381e242d35bf and project 97821d0c0c79446abba323f103c8244a. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:06:38.678701 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-60e92945-4726-4674-99b4-086d530d99e8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Going to run 1 instances... {{(pid=128789) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 15:06:38.683667 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-60e92945-4726-4674-99b4-086d530d99e8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4c11159-1e41-437a-af97-eb5f10704ae6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 15:06:38.774267 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cd1a8e06-7b61-4084-927a-30cfa4e99f33 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:38.775358 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cd1a8e06-7b61-4084-927a-30cfa4e99f33 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:38.782376 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd1a8e06-7b61-4084-927a-30cfa4e99f33 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:38.782817 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd1a8e06-7b61-4084-927a-30cfa4e99f33 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:38.783600 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd1a8e06-7b61-4084-927a-30cfa4e99f33 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:38.784030 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd1a8e06-7b61-4084-927a-30cfa4e99f33 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:38.813614 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cd1a8e06-7b61-4084-927a-30cfa4e99f33 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043487 Jan 05 15:06:38.814399 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 495/983] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Jan 5 15:06:38 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:06:38.858710 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-60e92945-4726-4674-99b4-086d530d99e8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635313 Jan 05 15:06:38.859485 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 489/984] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 15:06:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 15:06:38.868633 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b3bd553b-2853-47d5-a7af-f90d8bfddf1c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:38.869285 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b3bd553b-2853-47d5-a7af-f90d8bfddf1c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:38.871249 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-886b083f-5e96-4d3a-8ce4-7195679e1926 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:38.871915 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-886b083f-5e96-4d3a-8ce4-7195679e1926 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:38.884405 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-886b083f-5e96-4d3a-8ce4-7195679e1926 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:38.884917 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-886b083f-5e96-4d3a-8ce4-7195679e1926 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:38.886563 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-886b083f-5e96-4d3a-8ce4-7195679e1926 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:38.887152 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-886b083f-5e96-4d3a-8ce4-7195679e1926 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:38.913647 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-886b083f-5e96-4d3a-8ce4-7195679e1926 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Going to try to terminate instance {{(pid=128789) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:06:38.923747 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b3bd553b-2853-47d5-a7af-f90d8bfddf1c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:38.931590 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b3bd553b-2853-47d5-a7af-f90d8bfddf1c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 200 len: 1218 microversion: 2.1 time: 0.066539 Jan 05 15:06:38.933112 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 496/985] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:38 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:39.140080 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-773802d0-7385-4585-886c-924b95163ca3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:39.140699 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-773802d0-7385-4585-886c-924b95163ca3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:39.146855 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-773802d0-7385-4585-886c-924b95163ca3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:39.147296 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-773802d0-7385-4585-886c-924b95163ca3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:39.148063 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-773802d0-7385-4585-886c-924b95163ca3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:39.148489 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-773802d0-7385-4585-886c-924b95163ca3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:39.272441 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-886b083f-5e96-4d3a-8ce4-7195679e1926 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 204 len: 0 microversion: 2.20 time: 0.405344 Jan 05 15:06:39.273757 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 490/986] 10.222.0.30 () {60 vars in 1279 bytes} [Wed Jan 5 15:06:38 2022] DELETE /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 05 15:06:39.282340 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-09c39352-9149-45fb-bab3-61ab3798ad95 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:39.283038 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-09c39352-9149-45fb-bab3-61ab3798ad95 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:39.286194 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-773802d0-7385-4585-886c-924b95163ca3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:39.289616 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-09c39352-9149-45fb-bab3-61ab3798ad95 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:39.290057 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-09c39352-9149-45fb-bab3-61ab3798ad95 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:39.290843 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-09c39352-9149-45fb-bab3-61ab3798ad95 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:39.291276 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-09c39352-9149-45fb-bab3-61ab3798ad95 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:39.297380 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-773802d0-7385-4585-886c-924b95163ca3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1574 microversion: 2.1 time: 0.161485 Jan 05 15:06:39.299380 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 497/987] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:39 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:06:39.433508 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-09c39352-9149-45fb-bab3-61ab3798ad95 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:39.441650 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-09c39352-9149-45fb-bab3-61ab3798ad95 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:39.443015 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-09c39352-9149-45fb-bab3-61ab3798ad95 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:39.444199 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-09c39352-9149-45fb-bab3-61ab3798ad95 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1724 microversion: 2.20 time: 0.166049 Jan 05 15:06:39.444745 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 491/988] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:06:39 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:06:39.948782 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-42631bb0-aa35-4124-b9f7-f092f17a057a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:39.949427 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-42631bb0-aa35-4124-b9f7-f092f17a057a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:39.956185 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42631bb0-aa35-4124-b9f7-f092f17a057a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:39.956763 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42631bb0-aa35-4124-b9f7-f092f17a057a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:39.957565 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42631bb0-aa35-4124-b9f7-f092f17a057a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:39.957992 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42631bb0-aa35-4124-b9f7-f092f17a057a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:40.028499 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-42631bb0-aa35-4124-b9f7-f092f17a057a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:40.036070 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-42631bb0-aa35-4124-b9f7-f092f17a057a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 200 len: 1222 microversion: 2.1 time: 0.091045 Jan 05 15:06:40.036639 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 498/989] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:39 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:40.315913 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f0e64534-50e1-4346-ab3b-d02fbaab1a75 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:40.316469 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f0e64534-50e1-4346-ab3b-d02fbaab1a75 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:40.323528 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f0e64534-50e1-4346-ab3b-d02fbaab1a75 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:40.325600 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f0e64534-50e1-4346-ab3b-d02fbaab1a75 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:40.326209 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f0e64534-50e1-4346-ab3b-d02fbaab1a75 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:40.327007 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f0e64534-50e1-4346-ab3b-d02fbaab1a75 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:40.461818 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-167e4b16-d794-4fc8-a4ff-b7a15cfb73bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:40.462442 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-167e4b16-d794-4fc8-a4ff-b7a15cfb73bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:40.466950 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f0e64534-50e1-4346-ab3b-d02fbaab1a75 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:40.469695 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-167e4b16-d794-4fc8-a4ff-b7a15cfb73bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:40.470145 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-167e4b16-d794-4fc8-a4ff-b7a15cfb73bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:40.470956 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-167e4b16-d794-4fc8-a4ff-b7a15cfb73bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:40.471415 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-167e4b16-d794-4fc8-a4ff-b7a15cfb73bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:40.479634 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f0e64534-50e1-4346-ab3b-d02fbaab1a75 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1574 microversion: 2.1 time: 0.167570 Jan 05 15:06:40.480209 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 492/990] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:40 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:40.600870 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-167e4b16-d794-4fc8-a4ff-b7a15cfb73bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:40.609222 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-167e4b16-d794-4fc8-a4ff-b7a15cfb73bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:40.610819 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-167e4b16-d794-4fc8-a4ff-b7a15cfb73bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:40.612137 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-167e4b16-d794-4fc8-a4ff-b7a15cfb73bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1724 microversion: 2.20 time: 0.153970 Jan 05 15:06:40.612702 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 499/991] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:06:40 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:06:41.054976 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-901bb390-7bae-41dc-a926-794765ee9f58 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:41.055585 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-901bb390-7bae-41dc-a926-794765ee9f58 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:41.061980 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-901bb390-7bae-41dc-a926-794765ee9f58 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:41.062481 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-901bb390-7bae-41dc-a926-794765ee9f58 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:41.063327 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-901bb390-7bae-41dc-a926-794765ee9f58 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:41.063779 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-901bb390-7bae-41dc-a926-794765ee9f58 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:41.130038 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-901bb390-7bae-41dc-a926-794765ee9f58 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:41.138049 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-901bb390-7bae-41dc-a926-794765ee9f58 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 200 len: 1278 microversion: 2.1 time: 0.086854 Jan 05 15:06:41.138645 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 493/992] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:41 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 1278 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:41.496661 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-32247f51-e30f-4516-9f4b-d9dfaa57cadc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:41.497309 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-32247f51-e30f-4516-9f4b-d9dfaa57cadc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:41.503396 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32247f51-e30f-4516-9f4b-d9dfaa57cadc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:41.503838 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32247f51-e30f-4516-9f4b-d9dfaa57cadc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:41.504613 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32247f51-e30f-4516-9f4b-d9dfaa57cadc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:41.505230 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32247f51-e30f-4516-9f4b-d9dfaa57cadc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:41.631567 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a8bad4f6-385e-433f-8949-3d058292ba36 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:41.632407 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-a8bad4f6-385e-433f-8949-3d058292ba36 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:41.639324 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a8bad4f6-385e-433f-8949-3d058292ba36 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:41.639779 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a8bad4f6-385e-433f-8949-3d058292ba36 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:41.640559 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a8bad4f6-385e-433f-8949-3d058292ba36 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:41.640991 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-a8bad4f6-385e-433f-8949-3d058292ba36 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:41.752334 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-32247f51-e30f-4516-9f4b-d9dfaa57cadc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:41.760770 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-32247f51-e30f-4516-9f4b-d9dfaa57cadc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1561 microversion: 2.1 time: 0.268819 Jan 05 15:06:41.772650 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 500/993] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:41 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1561 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:41.776894 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a8bad4f6-385e-433f-8949-3d058292ba36 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:41.785802 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a8bad4f6-385e-433f-8949-3d058292ba36 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:41.787428 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-a8bad4f6-385e-433f-8949-3d058292ba36 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:41.788648 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a8bad4f6-385e-433f-8949-3d058292ba36 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1724 microversion: 2.20 time: 0.160972 Jan 05 15:06:41.789243 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 494/994] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:06:41 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 15:06:42.155183 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1b5b9bb5-4c8a-46c1-b6be-4c7a64b09ef0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:42.155801 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1b5b9bb5-4c8a-46c1-b6be-4c7a64b09ef0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:42.161642 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b5b9bb5-4c8a-46c1-b6be-4c7a64b09ef0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:42.162088 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b5b9bb5-4c8a-46c1-b6be-4c7a64b09ef0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:42.162875 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b5b9bb5-4c8a-46c1-b6be-4c7a64b09ef0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:42.163326 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b5b9bb5-4c8a-46c1-b6be-4c7a64b09ef0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:42.497198 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-1b5b9bb5-4c8a-46c1-b6be-4c7a64b09ef0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:42.504354 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1b5b9bb5-4c8a-46c1-b6be-4c7a64b09ef0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 200 len: 1318 microversion: 2.1 time: 0.353433 Jan 05 15:06:42.505099 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 501/995] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:42 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:42.807787 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-5c0787b0-9272-4b23-b054-dc6da112455d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:42.808557 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-5c0787b0-9272-4b23-b054-dc6da112455d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:42.818915 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5c0787b0-9272-4b23-b054-dc6da112455d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:42.818915 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5c0787b0-9272-4b23-b054-dc6da112455d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:42.818915 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5c0787b0-9272-4b23-b054-dc6da112455d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:42.818915 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5c0787b0-9272-4b23-b054-dc6da112455d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:42.881321 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-5c0787b0-9272-4b23-b054-dc6da112455d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:42.890007 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-5c0787b0-9272-4b23-b054-dc6da112455d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:42.891738 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-5c0787b0-9272-4b23-b054-dc6da112455d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:42.892902 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-5c0787b0-9272-4b23-b054-dc6da112455d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1656 microversion: 2.20 time: 0.089439 Jan 05 15:06:42.894125 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 495/996] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:06:42 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1656 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:06:43.483417 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-92200b9a-a462-49fb-9610-df9c81db9d38 req-53e68f5c-df6c-4b03-b5d2-e75072073e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "name": "network-vif-deleted", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:06:43.491036 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:43.491036 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:06:43.492946 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-92200b9a-a462-49fb-9610-df9c81db9d38 req-53e68f5c-df6c-4b03-b5d2-e75072073e43 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:43.493621 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-92200b9a-a462-49fb-9610-df9c81db9d38 req-53e68f5c-df6c-4b03-b5d2-e75072073e43 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:43.506902 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-92200b9a-a462-49fb-9610-df9c81db9d38 req-53e68f5c-df6c-4b03-b5d2-e75072073e43 service nova] Creating event network-vif-deleted:0d57813b-5531-41c7-8d8d-8b2fc393b843 for instance a591f495-ff59-4865-87ea-c48041ea097f on hv-cinder-maste Jan 05 15:06:43.513181 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-92200b9a-a462-49fb-9610-df9c81db9d38 req-53e68f5c-df6c-4b03-b5d2-e75072073e43 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033693 Jan 05 15:06:43.513778 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 502/997] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:06:43.521317 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-49053876-02e9-4347-bdae-737ead3a2b45 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:43.521928 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-49053876-02e9-4347-bdae-737ead3a2b45 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:43.528599 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-49053876-02e9-4347-bdae-737ead3a2b45 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:43.529041 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-49053876-02e9-4347-bdae-737ead3a2b45 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:43.529961 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-49053876-02e9-4347-bdae-737ead3a2b45 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:43.530396 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-49053876-02e9-4347-bdae-737ead3a2b45 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:43.684073 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-49053876-02e9-4347-bdae-737ead3a2b45 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:43.692028 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-49053876-02e9-4347-bdae-737ead3a2b45 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 200 len: 1318 microversion: 2.1 time: 0.174618 Jan 05 15:06:43.693106 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 496/998] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:43 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:43.912798 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-429c8e05-a458-49c1-a77a-7362ffffbe01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:43.913796 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-429c8e05-a458-49c1-a77a-7362ffffbe01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:43.920333 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-429c8e05-a458-49c1-a77a-7362ffffbe01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:43.920993 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-429c8e05-a458-49c1-a77a-7362ffffbe01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:43.921809 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-429c8e05-a458-49c1-a77a-7362ffffbe01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:43.922449 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-429c8e05-a458-49c1-a77a-7362ffffbe01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:43.956242 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-429c8e05-a458-49c1-a77a-7362ffffbe01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:43.957144 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-429c8e05-a458-49c1-a77a-7362ffffbe01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:43.957600 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-429c8e05-a458-49c1-a77a-7362ffffbe01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lazy-loading 'fault' on Instance uuid a591f495-ff59-4865-87ea-c48041ea097f {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:06:44.003918 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-429c8e05-a458-49c1-a77a-7362ffffbe01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:44.013099 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-429c8e05-a458-49c1-a77a-7362ffffbe01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:44.014645 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-429c8e05-a458-49c1-a77a-7362ffffbe01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd43400b4646449ce94967ec5bab4eca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:44.015800 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-429c8e05-a458-49c1-a77a-7362ffffbe01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 200 len: 1371 microversion: 2.20 time: 0.107592 Jan 05 15:06:44.016712 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 503/999] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:06:43 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 15:06:44.709222 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-62f3c3e0-d503-423e-9449-1fc33ec65407 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:44.709864 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-62f3c3e0-d503-423e-9449-1fc33ec65407 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:44.716875 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-62f3c3e0-d503-423e-9449-1fc33ec65407 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:44.717350 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-62f3c3e0-d503-423e-9449-1fc33ec65407 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:44.718162 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-62f3c3e0-d503-423e-9449-1fc33ec65407 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:44.718593 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-62f3c3e0-d503-423e-9449-1fc33ec65407 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:44.846822 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-62f3c3e0-d503-423e-9449-1fc33ec65407 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:44.854291 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-62f3c3e0-d503-423e-9449-1fc33ec65407 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 200 len: 1318 microversion: 2.1 time: 0.148824 Jan 05 15:06:44.854850 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 497/1000] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:44 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:45.033613 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-af29814f-f04c-4bda-b7bc-517b7a779edb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:45.034213 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-af29814f-f04c-4bda-b7bc-517b7a779edb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:45.040349 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af29814f-f04c-4bda-b7bc-517b7a779edb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:45.040790 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af29814f-f04c-4bda-b7bc-517b7a779edb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:45.041580 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af29814f-f04c-4bda-b7bc-517b7a779edb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:45.042010 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af29814f-f04c-4bda-b7bc-517b7a779edb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:45.055625 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-af29814f-f04c-4bda-b7bc-517b7a779edb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] HTTP exception thrown: Instance a591f495-ff59-4865-87ea-c48041ea097f could not be found. Jan 05 15:06:45.056118 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-af29814f-f04c-4bda-b7bc-517b7a779edb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Returning 404 to user: Instance a591f495-ff59-4865-87ea-c48041ea097f could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:06:45.056918 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-af29814f-f04c-4bda-b7bc-517b7a779edb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 404 len: 111 microversion: 2.20 time: 0.027015 Jan 05 15:06:45.057444 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 504/1001] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:06:45 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 05 15:06:45.065769 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-64e23562-f492-4df9-ae08-51dd27f4d59e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '.version_select at 0x7f21722faa60>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:45.150757 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-64e23562-f492-4df9-ae08-51dd27f4d59e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1625399607" status: 204 len: 0 microversion: 2.20 time: 0.088609 Jan 05 15:06:45.151323 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 498/1002] 10.222.0.30 () {60 vars in 1261 bytes} [Wed Jan 5 15:06:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1625399607 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 05 15:06:45.533162 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a5d7f183-4d6a-42ba-9b87-960020bdfb22 req-6a5cae84-8a30-4f74-bb80-dad9efdeca7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0513327c-8038-49b0-a926-007e79f1c41c", "tag": "b4ef5996-5211-497a-bab8-d83c88eea0df"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:06:45.534718 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:45.534718 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:06:45.541320 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a5d7f183-4d6a-42ba-9b87-960020bdfb22 req-6a5cae84-8a30-4f74-bb80-dad9efdeca7e service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:45.541758 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a5d7f183-4d6a-42ba-9b87-960020bdfb22 req-6a5cae84-8a30-4f74-bb80-dad9efdeca7e service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:45.552739 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a5d7f183-4d6a-42ba-9b87-960020bdfb22 req-6a5cae84-8a30-4f74-bb80-dad9efdeca7e service nova] Creating event network-changed:b4ef5996-5211-497a-bab8-d83c88eea0df for instance 0513327c-8038-49b0-a926-007e79f1c41c on hv-cinder-maste Jan 05 15:06:45.557649 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a5d7f183-4d6a-42ba-9b87-960020bdfb22 req-6a5cae84-8a30-4f74-bb80-dad9efdeca7e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028049 Jan 05 15:06:45.559123 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 505/1003] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:06:45.871201 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-fd5b1de3-8de7-4fed-89ad-1f9832f7d032 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:45.871813 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-fd5b1de3-8de7-4fed-89ad-1f9832f7d032 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:45.878065 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fd5b1de3-8de7-4fed-89ad-1f9832f7d032 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:45.878516 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fd5b1de3-8de7-4fed-89ad-1f9832f7d032 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:45.879366 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fd5b1de3-8de7-4fed-89ad-1f9832f7d032 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:45.879804 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fd5b1de3-8de7-4fed-89ad-1f9832f7d032 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:46.013412 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-fd5b1de3-8de7-4fed-89ad-1f9832f7d032 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:46.020662 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-fd5b1de3-8de7-4fed-89ad-1f9832f7d032 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 200 len: 1318 microversion: 2.1 time: 0.153657 Jan 05 15:06:46.021258 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 499/1004] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:45 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:47.037802 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9cfff50f-7bce-47b4-98fd-25be4b254cde tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:47.038498 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9cfff50f-7bce-47b4-98fd-25be4b254cde tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:47.045617 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cfff50f-7bce-47b4-98fd-25be4b254cde tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:47.046064 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cfff50f-7bce-47b4-98fd-25be4b254cde tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:47.046832 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cfff50f-7bce-47b4-98fd-25be4b254cde tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:47.047256 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cfff50f-7bce-47b4-98fd-25be4b254cde tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:47.183046 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-9cfff50f-7bce-47b4-98fd-25be4b254cde tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:47.190493 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9cfff50f-7bce-47b4-98fd-25be4b254cde tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 200 len: 1318 microversion: 2.1 time: 0.156901 Jan 05 15:06:47.191064 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 506/1005] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:47 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:47.423137 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-057c6496-90fc-400e-94a1-141e32451d39 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:47.423678 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-057c6496-90fc-400e-94a1-141e32451d39 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:47.429983 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-057c6496-90fc-400e-94a1-141e32451d39 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:47.430556 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-057c6496-90fc-400e-94a1-141e32451d39 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:47.431499 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-057c6496-90fc-400e-94a1-141e32451d39 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:47.431932 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-057c6496-90fc-400e-94a1-141e32451d39 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:47.445663 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-057c6496-90fc-400e-94a1-141e32451d39 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] HTTP exception thrown: Instance a591f495-ff59-4865-87ea-c48041ea097f could not be found. Jan 05 15:06:47.446165 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-057c6496-90fc-400e-94a1-141e32451d39 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Returning 404 to user: Instance a591f495-ff59-4865-87ea-c48041ea097f could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:06:47.447007 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-057c6496-90fc-400e-94a1-141e32451d39 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 404 len: 111 microversion: 2.20 time: 0.027574 Jan 05 15:06:47.447527 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 500/1006] 10.222.0.30 () {60 vars in 1279 bytes} [Wed Jan 5 15:06:47 2022] DELETE /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 05 15:06:47.455847 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8abc1060-c298-4441-8293-ba792fdb4b49 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:47.456539 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8abc1060-c298-4441-8293-ba792fdb4b49 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: a591f495-ff59-4865-87ea-c48041ea097f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:47.462348 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8abc1060-c298-4441-8293-ba792fdb4b49 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:47.462800 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8abc1060-c298-4441-8293-ba792fdb4b49 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:47.463579 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8abc1060-c298-4441-8293-ba792fdb4b49 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:47.464014 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8abc1060-c298-4441-8293-ba792fdb4b49 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:47.476625 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-8abc1060-c298-4441-8293-ba792fdb4b49 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] HTTP exception thrown: Instance a591f495-ff59-4865-87ea-c48041ea097f could not be found. Jan 05 15:06:47.477496 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8abc1060-c298-4441-8293-ba792fdb4b49 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Returning 404 to user: Instance a591f495-ff59-4865-87ea-c48041ea097f could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:06:47.478296 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8abc1060-c298-4441-8293-ba792fdb4b49 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f" status: 404 len: 111 microversion: 2.20 time: 0.026175 Jan 05 15:06:47.478813 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 507/1007] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:06:47 2022] GET /compute/v2.1/servers/a591f495-ff59-4865-87ea-c48041ea097f => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 05 15:06:48.206794 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c2e5b86d-b701-41bb-a118-b5cd9179edef tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:48.207411 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c2e5b86d-b701-41bb-a118-b5cd9179edef tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:48.213569 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c2e5b86d-b701-41bb-a118-b5cd9179edef tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:48.214017 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c2e5b86d-b701-41bb-a118-b5cd9179edef tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:48.214839 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c2e5b86d-b701-41bb-a118-b5cd9179edef tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:48.215321 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c2e5b86d-b701-41bb-a118-b5cd9179edef tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:48.349342 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c2e5b86d-b701-41bb-a118-b5cd9179edef tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:48.356940 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c2e5b86d-b701-41bb-a118-b5cd9179edef tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 200 len: 1318 microversion: 2.1 time: 0.153803 Jan 05 15:06:48.357522 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 501/1008] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:48 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:48.742289 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3e8d290b-8950-4a09-90d8-b1d559c298c5 req-237757d2-b49d-4c52-88e2-17bcb71c1655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0513327c-8038-49b0-a926-007e79f1c41c", "name": "network-vif-plugged", "status": "completed", "tag": "b4ef5996-5211-497a-bab8-d83c88eea0df"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:06:48.743122 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-19de3d5f-3f74-4acd-95d0-8bf392fe2545 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:48.743648 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-19de3d5f-3f74-4acd-95d0-8bf392fe2545 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:48.743865 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:48.743865 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:06:48.750831 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-19de3d5f-3f74-4acd-95d0-8bf392fe2545 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:48.751291 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-19de3d5f-3f74-4acd-95d0-8bf392fe2545 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:48.751427 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3e8d290b-8950-4a09-90d8-b1d559c298c5 req-237757d2-b49d-4c52-88e2-17bcb71c1655 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:48.751816 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3e8d290b-8950-4a09-90d8-b1d559c298c5 req-237757d2-b49d-4c52-88e2-17bcb71c1655 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:48.752075 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-19de3d5f-3f74-4acd-95d0-8bf392fe2545 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:48.752512 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-19de3d5f-3f74-4acd-95d0-8bf392fe2545 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:48.762852 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3e8d290b-8950-4a09-90d8-b1d559c298c5 req-237757d2-b49d-4c52-88e2-17bcb71c1655 service nova] Creating event network-vif-plugged:b4ef5996-5211-497a-bab8-d83c88eea0df for instance 0513327c-8038-49b0-a926-007e79f1c41c on hv-cinder-maste Jan 05 15:06:48.766224 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-19de3d5f-3f74-4acd-95d0-8bf392fe2545 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] HTTP exception thrown: Instance 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 could not be found. Jan 05 15:06:48.766816 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-19de3d5f-3f74-4acd-95d0-8bf392fe2545 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Returning 404 to user: Instance 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:06:48.767697 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-19de3d5f-3f74-4acd-95d0-8bf392fe2545 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 404 len: 111 microversion: 2.20 time: 0.028675 Jan 05 15:06:48.767972 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3e8d290b-8950-4a09-90d8-b1d559c298c5 req-237757d2-b49d-4c52-88e2-17bcb71c1655 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029447 Jan 05 15:06:48.768240 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 502/1009] 10.222.0.30 () {60 vars in 1279 bytes} [Wed Jan 5 15:06:48 2022] DELETE /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 05 15:06:48.768605 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 508/1010] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:06:48.776358 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-5f126d65-9709-49fe-98c0-ce077398fcfc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:48.776967 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-5f126d65-9709-49fe-98c0-ce077398fcfc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] [instance: 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:48.782827 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5f126d65-9709-49fe-98c0-ce077398fcfc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:48.783286 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5f126d65-9709-49fe-98c0-ce077398fcfc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:48.784068 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5f126d65-9709-49fe-98c0-ce077398fcfc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:48.784511 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5f126d65-9709-49fe-98c0-ce077398fcfc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:48.798070 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-5f126d65-9709-49fe-98c0-ce077398fcfc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] HTTP exception thrown: Instance 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 could not be found. Jan 05 15:06:48.798846 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-5f126d65-9709-49fe-98c0-ce077398fcfc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Returning 404 to user: Instance 1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:06:48.799660 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-5f126d65-9709-49fe-98c0-ce077398fcfc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75" status: 404 len: 111 microversion: 2.20 time: 0.027146 Jan 05 15:06:48.800179 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 503/1011] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Jan 5 15:06:48 2022] GET /compute/v2.1/servers/1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 05 15:06:49.374306 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-026aa699-849b-46bb-baf2-888fb97cde2e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:49.375011 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-026aa699-849b-46bb-baf2-888fb97cde2e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:49.381404 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-026aa699-849b-46bb-baf2-888fb97cde2e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:49.381857 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-026aa699-849b-46bb-baf2-888fb97cde2e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:49.382694 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-026aa699-849b-46bb-baf2-888fb97cde2e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:49.383131 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-026aa699-849b-46bb-baf2-888fb97cde2e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:49.564163 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-026aa699-849b-46bb-baf2-888fb97cde2e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:49.571498 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-026aa699-849b-46bb-baf2-888fb97cde2e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 200 len: 1318 microversion: 2.1 time: 0.201781 Jan 05 15:06:49.572068 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 509/1012] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:49 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:50.588965 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d2233c73-9dfe-491b-8e1a-ab8fdda2444e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:06:50.590754 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d2233c73-9dfe-491b-8e1a-ab8fdda2444e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:50.596511 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d2233c73-9dfe-491b-8e1a-ab8fdda2444e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:50.596964 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d2233c73-9dfe-491b-8e1a-ab8fdda2444e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:50.597811 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d2233c73-9dfe-491b-8e1a-ab8fdda2444e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:50.598248 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d2233c73-9dfe-491b-8e1a-ab8fdda2444e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:50.738722 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d2233c73-9dfe-491b-8e1a-ab8fdda2444e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:06:50.746292 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d2233c73-9dfe-491b-8e1a-ab8fdda2444e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 200 len: 1507 microversion: 2.1 time: 0.161805 Jan 05 15:06:50.747318 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 504/1013] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:06:50 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:06:52.398831 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7bd5c45d-284d-4cf1-a4fc-123fefe9b6be tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cebd09d4-2a9a-4daa-99c2-cac8912c4466"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:06:52.399826 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7bd5c45d-284d-4cf1-a4fc-123fefe9b6be tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:06:52.407035 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bd5c45d-284d-4cf1-a4fc-123fefe9b6be tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:52.411129 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bd5c45d-284d-4cf1-a4fc-123fefe9b6be tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:52.411129 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bd5c45d-284d-4cf1-a4fc-123fefe9b6be tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:06:52.411129 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bd5c45d-284d-4cf1-a4fc-123fefe9b6be tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:06:53.327693 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7bd5c45d-284d-4cf1-a4fc-123fefe9b6be tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "POST /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.932404 Jan 05 15:06:53.328386 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 510/1014] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Jan 5 15:06:52 2022] POST /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c/os-volume_attachments => generated 194 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:07:00.793375 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e888eb00-d437-4bb6-ab4f-9511a380b2e3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cebd09d4-2a9a-4daa-99c2-cac8912c4466"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:07:00.794475 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e888eb00-d437-4bb6-ab4f-9511a380b2e3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:00.800801 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e888eb00-d437-4bb6-ab4f-9511a380b2e3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:00.803791 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e888eb00-d437-4bb6-ab4f-9511a380b2e3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:00.803791 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e888eb00-d437-4bb6-ab4f-9511a380b2e3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:00.803791 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e888eb00-d437-4bb6-ab4f-9511a380b2e3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:00.878355 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-e888eb00-d437-4bb6-ab4f-9511a380b2e3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] HTTP exception thrown: Invalid volume: volume cebd09d4-2a9a-4daa-99c2-cac8912c4466 is already attached to instances: 0513327c-8038-49b0-a926-007e79f1c41c Jan 05 15:07:00.878947 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e888eb00-d437-4bb6-ab4f-9511a380b2e3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Returning 400 to user: Invalid volume: volume cebd09d4-2a9a-4daa-99c2-cac8912c4466 is already attached to instances: 0513327c-8038-49b0-a926-007e79f1c41c {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:07:00.879825 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e888eb00-d437-4bb6-ab4f-9511a380b2e3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "POST /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090319 Jan 05 15:07:00.880369 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 505/1015] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Jan 5 15:07:00 2022] POST /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 05 15:07:00.940331 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5825bbf7-1d43-4a2a-a146-82c613e084d2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:00.940912 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5825bbf7-1d43-4a2a-a146-82c613e084d2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:00.947102 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5825bbf7-1d43-4a2a-a146-82c613e084d2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:00.954658 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5825bbf7-1d43-4a2a-a146-82c613e084d2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:00.954658 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5825bbf7-1d43-4a2a-a146-82c613e084d2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:00.954658 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5825bbf7-1d43-4a2a-a146-82c613e084d2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:01.025701 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-5825bbf7-1d43-4a2a-a146-82c613e084d2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lazy-loading 'services' on Instance uuid 0513327c-8038-49b0-a926-007e79f1c41c {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:07:01.333653 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5825bbf7-1d43-4a2a-a146-82c613e084d2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c/os-volume_attachments/cebd09d4-2a9a-4daa-99c2-cac8912c4466" status: 202 len: 0 microversion: 2.1 time: 0.397666 Jan 05 15:07:01.334240 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 511/1016] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Jan 5 15:07:00 2022] DELETE /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c/os-volume_attachments/cebd09d4-2a9a-4daa-99c2-cac8912c4466 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:07:01.343902 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ad71d909-d1e7-4d87-8bda-4a17c0f57898 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:01.344895 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ad71d909-d1e7-4d87-8bda-4a17c0f57898 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:01.350817 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ad71d909-d1e7-4d87-8bda-4a17c0f57898 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:01.351264 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ad71d909-d1e7-4d87-8bda-4a17c0f57898 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:01.352334 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ad71d909-d1e7-4d87-8bda-4a17c0f57898 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:01.352763 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ad71d909-d1e7-4d87-8bda-4a17c0f57898 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:01.381594 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ad71d909-d1e7-4d87-8bda-4a17c0f57898 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042964 Jan 05 15:07:01.389237 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 506/1017] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:07:01 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:07:02.398574 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7599b39f-7eea-4dc5-a63b-e1494c3a5449 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:02.403344 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7599b39f-7eea-4dc5-a63b-e1494c3a5449 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:02.406181 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7599b39f-7eea-4dc5-a63b-e1494c3a5449 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:02.406637 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7599b39f-7eea-4dc5-a63b-e1494c3a5449 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:02.407419 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7599b39f-7eea-4dc5-a63b-e1494c3a5449 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:02.407855 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7599b39f-7eea-4dc5-a63b-e1494c3a5449 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:02.437398 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7599b39f-7eea-4dc5-a63b-e1494c3a5449 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043253 Jan 05 15:07:02.438142 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 512/1018] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:07:02 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:07:03.448957 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f00ed1c0-037b-4ad0-877c-69a833080ea0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:03.450526 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f00ed1c0-037b-4ad0-877c-69a833080ea0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:03.456744 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f00ed1c0-037b-4ad0-877c-69a833080ea0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:03.457244 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f00ed1c0-037b-4ad0-877c-69a833080ea0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:03.458021 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f00ed1c0-037b-4ad0-877c-69a833080ea0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:03.458458 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f00ed1c0-037b-4ad0-877c-69a833080ea0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:03.486881 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f00ed1c0-037b-4ad0-877c-69a833080ea0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041830 Jan 05 15:07:03.487424 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 507/1019] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:07:03 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:07:03.629873 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4184858c-2338-4108-91da-6bc09144ee7c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1562858800", "imageRef": "e4c11159-1e41-437a-af97-eb5f10704ae6", "flavorRef": "452", "networks": [{"uuid": "15d9f439-989e-49bd-a540-259f7f374d29"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:07:03.679081 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-4184858c-2338-4108-91da-6bc09144ee7c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] validate_networks() for [('15d9f439-989e-49bd-a540-259f7f374d29', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 15:07:04.044184 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4184858c-2338-4108-91da-6bc09144ee7c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 15:07:04.044600 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4184858c-2338-4108-91da-6bc09144ee7c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 15:07:04.045116 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4184858c-2338-4108-91da-6bc09144ee7c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 15:07:04.045522 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4184858c-2338-4108-91da-6bc09144ee7c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 15:07:04.045927 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4184858c-2338-4108-91da-6bc09144ee7c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 15:07:04.055151 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4184858c-2338-4108-91da-6bc09144ee7c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:04.055609 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4184858c-2338-4108-91da-6bc09144ee7c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:04.056391 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4184858c-2338-4108-91da-6bc09144ee7c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:04.056824 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4184858c-2338-4108-91da-6bc09144ee7c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:04.072712 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-4184858c-2338-4108-91da-6bc09144ee7c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Getting quotas for project 97821d0c0c79446abba323f103c8244a. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:07:04.076639 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-4184858c-2338-4108-91da-6bc09144ee7c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Getting quotas for user e1578e40c006442ca632381e242d35bf and project 97821d0c0c79446abba323f103c8244a. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:07:04.087519 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4184858c-2338-4108-91da-6bc09144ee7c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 15:07:04.090453 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4184858c-2338-4108-91da-6bc09144ee7c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4c11159-1e41-437a-af97-eb5f10704ae6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 15:07:04.261339 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4184858c-2338-4108-91da-6bc09144ee7c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635117 Jan 05 15:07:04.262244 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 513/1020] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 15:07:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 15:07:04.271515 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-360406b0-f8c2-47e0-99ef-25bb42df0068 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:04.272133 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-360406b0-f8c2-47e0-99ef-25bb42df0068 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:04.323827 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-360406b0-f8c2-47e0-99ef-25bb42df0068 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:04.332240 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-360406b0-f8c2-47e0-99ef-25bb42df0068 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1218 microversion: 2.1 time: 0.064239 Jan 05 15:07:04.332897 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 508/1021] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:04 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:05.350028 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4b0710ec-d3dc-40bf-b14d-f29161ac9caa tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:05.350639 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4b0710ec-d3dc-40bf-b14d-f29161ac9caa tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:05.357473 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b0710ec-d3dc-40bf-b14d-f29161ac9caa tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:05.357921 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b0710ec-d3dc-40bf-b14d-f29161ac9caa tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:05.358820 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b0710ec-d3dc-40bf-b14d-f29161ac9caa tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:05.359263 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b0710ec-d3dc-40bf-b14d-f29161ac9caa tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:05.424643 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4b0710ec-d3dc-40bf-b14d-f29161ac9caa tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:05.431984 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4b0710ec-d3dc-40bf-b14d-f29161ac9caa tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1222 microversion: 2.1 time: 0.086241 Jan 05 15:07:05.432561 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 514/1022] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:05 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:06.449686 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-947873c5-fe7a-460f-bbd3-ab6c21ef888c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:06.450303 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-947873c5-fe7a-460f-bbd3-ab6c21ef888c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:06.456751 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-947873c5-fe7a-460f-bbd3-ab6c21ef888c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:06.457229 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-947873c5-fe7a-460f-bbd3-ab6c21ef888c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:06.458199 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-947873c5-fe7a-460f-bbd3-ab6c21ef888c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:06.458666 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-947873c5-fe7a-460f-bbd3-ab6c21ef888c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:06.520847 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-947873c5-fe7a-460f-bbd3-ab6c21ef888c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:06.528257 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-947873c5-fe7a-460f-bbd3-ab6c21ef888c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1278 microversion: 2.1 time: 0.083101 Jan 05 15:07:06.528904 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 509/1023] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:06 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1278 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:07.547227 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-609b7693-3550-4f37-bbe5-796d8abfd1a3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:07.549410 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-609b7693-3550-4f37-bbe5-796d8abfd1a3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:07.556580 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-609b7693-3550-4f37-bbe5-796d8abfd1a3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:07.557183 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-609b7693-3550-4f37-bbe5-796d8abfd1a3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:07.558097 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-609b7693-3550-4f37-bbe5-796d8abfd1a3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:07.558891 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-609b7693-3550-4f37-bbe5-796d8abfd1a3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:07.811068 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-609b7693-3550-4f37-bbe5-796d8abfd1a3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:07.820127 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-609b7693-3550-4f37-bbe5-796d8abfd1a3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1318 microversion: 2.1 time: 0.278180 Jan 05 15:07:07.820701 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 515/1024] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:07 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:08.335377 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-50ff12c3-6cdc-40e9-9716-ff40ba35d5bd req-3ea0b462-b587-46bd-895b-fb87e8ded62c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb26e42e-5e97-4336-aa5c-20a7f5b439ed", "tag": "32e08202-b8ca-4301-9648-36aacfa35c0a"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:07:08.337704 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:07:08.337704 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:07:08.345190 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-50ff12c3-6cdc-40e9-9716-ff40ba35d5bd req-3ea0b462-b587-46bd-895b-fb87e8ded62c service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:08.345639 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-50ff12c3-6cdc-40e9-9716-ff40ba35d5bd req-3ea0b462-b587-46bd-895b-fb87e8ded62c service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:08.357046 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-50ff12c3-6cdc-40e9-9716-ff40ba35d5bd req-3ea0b462-b587-46bd-895b-fb87e8ded62c service nova] Creating event network-changed:32e08202-b8ca-4301-9648-36aacfa35c0a for instance cb26e42e-5e97-4336-aa5c-20a7f5b439ed on hv-cinder-maste Jan 05 15:07:08.362016 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-50ff12c3-6cdc-40e9-9716-ff40ba35d5bd req-3ea0b462-b587-46bd-895b-fb87e8ded62c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030266 Jan 05 15:07:08.362586 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 510/1025] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:07:08.837710 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-17d159c8-cba6-49c2-ba93-5633ad36106f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:08.838447 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-17d159c8-cba6-49c2-ba93-5633ad36106f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:08.845598 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17d159c8-cba6-49c2-ba93-5633ad36106f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:08.846226 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17d159c8-cba6-49c2-ba93-5633ad36106f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:08.847007 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17d159c8-cba6-49c2-ba93-5633ad36106f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:08.847641 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17d159c8-cba6-49c2-ba93-5633ad36106f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:09.063020 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-17d159c8-cba6-49c2-ba93-5633ad36106f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:09.071699 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-17d159c8-cba6-49c2-ba93-5633ad36106f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1318 microversion: 2.1 time: 0.238057 Jan 05 15:07:09.080655 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 516/1026] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:08 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:10.088292 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3036e5bf-29e8-4fbd-a132-92cd569993e4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:10.089000 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3036e5bf-29e8-4fbd-a132-92cd569993e4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:10.095524 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3036e5bf-29e8-4fbd-a132-92cd569993e4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:10.095977 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3036e5bf-29e8-4fbd-a132-92cd569993e4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:10.096763 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3036e5bf-29e8-4fbd-a132-92cd569993e4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:10.097243 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3036e5bf-29e8-4fbd-a132-92cd569993e4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:10.237253 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3036e5bf-29e8-4fbd-a132-92cd569993e4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:10.244429 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3036e5bf-29e8-4fbd-a132-92cd569993e4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1318 microversion: 2.1 time: 0.160105 Jan 05 15:07:10.244980 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 511/1027] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:10 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:11.260694 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cae848ae-b238-4df4-97bf-0b0f49e08653 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:11.261360 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cae848ae-b238-4df4-97bf-0b0f49e08653 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:11.267760 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cae848ae-b238-4df4-97bf-0b0f49e08653 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:11.268205 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cae848ae-b238-4df4-97bf-0b0f49e08653 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:11.268992 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cae848ae-b238-4df4-97bf-0b0f49e08653 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:11.269466 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cae848ae-b238-4df4-97bf-0b0f49e08653 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:11.407059 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-cae848ae-b238-4df4-97bf-0b0f49e08653 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:11.414471 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cae848ae-b238-4df4-97bf-0b0f49e08653 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1318 microversion: 2.1 time: 0.157378 Jan 05 15:07:11.415038 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 517/1028] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:11 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:12.431465 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f8b6d643-e7a9-44ce-ba62-a1bf3b81d2ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:12.432157 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f8b6d643-e7a9-44ce-ba62-a1bf3b81d2ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:12.439047 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f8b6d643-e7a9-44ce-ba62-a1bf3b81d2ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:12.439502 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f8b6d643-e7a9-44ce-ba62-a1bf3b81d2ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:12.440275 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f8b6d643-e7a9-44ce-ba62-a1bf3b81d2ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:12.440769 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f8b6d643-e7a9-44ce-ba62-a1bf3b81d2ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:12.572207 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f8b6d643-e7a9-44ce-ba62-a1bf3b81d2ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:12.579525 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f8b6d643-e7a9-44ce-ba62-a1bf3b81d2ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1318 microversion: 2.1 time: 0.151779 Jan 05 15:07:12.580093 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 512/1029] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:12 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:13.595758 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2ee4c96b-22f9-4a32-9747-a44cb2e4d652 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:13.596292 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2ee4c96b-22f9-4a32-9747-a44cb2e4d652 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:13.602878 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ee4c96b-22f9-4a32-9747-a44cb2e4d652 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:13.603320 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ee4c96b-22f9-4a32-9747-a44cb2e4d652 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:13.604083 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ee4c96b-22f9-4a32-9747-a44cb2e4d652 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:13.604506 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ee4c96b-22f9-4a32-9747-a44cb2e4d652 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:13.738976 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-2ee4c96b-22f9-4a32-9747-a44cb2e4d652 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:13.746296 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2ee4c96b-22f9-4a32-9747-a44cb2e4d652 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1318 microversion: 2.1 time: 0.154372 Jan 05 15:07:13.746868 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 518/1030] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:13 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:14.762901 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-0c5e73a6-c283-46e8-88dc-3266ed9822e7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:14.763510 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0c5e73a6-c283-46e8-88dc-3266ed9822e7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:14.769597 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0c5e73a6-c283-46e8-88dc-3266ed9822e7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:14.770106 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0c5e73a6-c283-46e8-88dc-3266ed9822e7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:14.770920 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0c5e73a6-c283-46e8-88dc-3266ed9822e7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:14.771361 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0c5e73a6-c283-46e8-88dc-3266ed9822e7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:14.903458 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-0c5e73a6-c283-46e8-88dc-3266ed9822e7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:14.911435 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-0c5e73a6-c283-46e8-88dc-3266ed9822e7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1318 microversion: 2.1 time: 0.152368 Jan 05 15:07:14.912799 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 513/1031] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:14 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:14.915417 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-41c1932b-bb52-412a-8197-63a77a2d03d2 req-2619a535-a042-44e6-afcc-9604efd8695f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb26e42e-5e97-4336-aa5c-20a7f5b439ed", "name": "network-vif-plugged", "status": "completed", "tag": "32e08202-b8ca-4301-9648-36aacfa35c0a"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:07:14.917051 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:07:14.917051 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:07:14.924157 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-41c1932b-bb52-412a-8197-63a77a2d03d2 req-2619a535-a042-44e6-afcc-9604efd8695f service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:14.924820 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-41c1932b-bb52-412a-8197-63a77a2d03d2 req-2619a535-a042-44e6-afcc-9604efd8695f service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:14.935844 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-41c1932b-bb52-412a-8197-63a77a2d03d2 req-2619a535-a042-44e6-afcc-9604efd8695f service nova] Creating event network-vif-plugged:32e08202-b8ca-4301-9648-36aacfa35c0a for instance cb26e42e-5e97-4336-aa5c-20a7f5b439ed on hv-cinder-maste Jan 05 15:07:14.940752 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-41c1932b-bb52-412a-8197-63a77a2d03d2 req-2619a535-a042-44e6-afcc-9604efd8695f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029193 Jan 05 15:07:14.941392 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 519/1032] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:07:15.927360 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-9023b180-614d-4060-97d5-25560247e1e6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:15.927960 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-9023b180-614d-4060-97d5-25560247e1e6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:15.934151 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9023b180-614d-4060-97d5-25560247e1e6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:15.934597 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9023b180-614d-4060-97d5-25560247e1e6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:15.935367 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9023b180-614d-4060-97d5-25560247e1e6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:15.935800 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9023b180-614d-4060-97d5-25560247e1e6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:16.063127 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-9023b180-614d-4060-97d5-25560247e1e6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:16.070510 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-9023b180-614d-4060-97d5-25560247e1e6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1318 microversion: 2.1 time: 0.146772 Jan 05 15:07:16.071075 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 514/1033] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:15 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:17.087736 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d9597083-423e-4f8c-99a9-3c19566ac4c7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:17.088365 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d9597083-423e-4f8c-99a9-3c19566ac4c7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:17.094951 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9597083-423e-4f8c-99a9-3c19566ac4c7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:17.095406 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9597083-423e-4f8c-99a9-3c19566ac4c7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:17.096235 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9597083-423e-4f8c-99a9-3c19566ac4c7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:17.096673 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9597083-423e-4f8c-99a9-3c19566ac4c7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:17.225785 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-d9597083-423e-4f8c-99a9-3c19566ac4c7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:17.231551 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d9597083-423e-4f8c-99a9-3c19566ac4c7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1508 microversion: 2.1 time: 0.148512 Jan 05 15:07:17.232117 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 520/1034] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:17 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:18.964099 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-41c838a1-4b67-4e21-aede-0c2159c93a12 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8a84179-a42d-459c-b386-b49d648e6144"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:07:18.965208 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-41c838a1-4b67-4e21-aede-0c2159c93a12 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:18.971565 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-41c838a1-4b67-4e21-aede-0c2159c93a12 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:18.972006 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-41c838a1-4b67-4e21-aede-0c2159c93a12 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:18.972772 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-41c838a1-4b67-4e21-aede-0c2159c93a12 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:18.973239 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-41c838a1-4b67-4e21-aede-0c2159c93a12 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:19.675444 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-41c838a1-4b67-4e21-aede-0c2159c93a12 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "POST /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.714910 Jan 05 15:07:19.676049 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 515/1035] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Jan 5 15:07:18 2022] POST /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed/os-volume_attachments => generated 194 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:07:28.314248 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4a6a3aea-ecb4-413e-9c71-1ab514ca23b5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:28.314759 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4a6a3aea-ecb4-413e-9c71-1ab514ca23b5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:28.320896 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a6a3aea-ecb4-413e-9c71-1ab514ca23b5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:28.321389 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a6a3aea-ecb4-413e-9c71-1ab514ca23b5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:28.322139 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a6a3aea-ecb4-413e-9c71-1ab514ca23b5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:28.322565 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a6a3aea-ecb4-413e-9c71-1ab514ca23b5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:28.399965 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-4a6a3aea-ecb4-413e-9c71-1ab514ca23b5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lazy-loading 'services' on Instance uuid cb26e42e-5e97-4336-aa5c-20a7f5b439ed {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:07:28.584610 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4a6a3aea-ecb4-413e-9c71-1ab514ca23b5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed/os-volume_attachments/e8a84179-a42d-459c-b386-b49d648e6144" status: 202 len: 0 microversion: 2.1 time: 0.273863 Jan 05 15:07:28.585230 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 521/1036] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Jan 5 15:07:28 2022] DELETE /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed/os-volume_attachments/e8a84179-a42d-459c-b386-b49d648e6144 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:07:28.594952 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-26f6a511-8602-45f8-8792-ec2b422dcef2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:28.596011 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-26f6a511-8602-45f8-8792-ec2b422dcef2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:28.602382 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-26f6a511-8602-45f8-8792-ec2b422dcef2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:28.602837 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-26f6a511-8602-45f8-8792-ec2b422dcef2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:28.603624 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-26f6a511-8602-45f8-8792-ec2b422dcef2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:28.604062 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-26f6a511-8602-45f8-8792-ec2b422dcef2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:28.633042 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-26f6a511-8602-45f8-8792-ec2b422dcef2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043169 Jan 05 15:07:28.633811 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 516/1037] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:07:28 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:07:29.650839 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d19374e3-c81f-4269-bd29-23afa2323086 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:29.650839 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d19374e3-c81f-4269-bd29-23afa2323086 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:29.653653 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d19374e3-c81f-4269-bd29-23afa2323086 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:29.654106 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d19374e3-c81f-4269-bd29-23afa2323086 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:29.654883 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d19374e3-c81f-4269-bd29-23afa2323086 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:29.655323 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d19374e3-c81f-4269-bd29-23afa2323086 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:29.683730 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d19374e3-c81f-4269-bd29-23afa2323086 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042035 Jan 05 15:07:29.684290 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 522/1038] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:07:29 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:07:30.695637 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c6d90199-eb0c-4d5c-9e63-6fd5d1302838 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:30.696447 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c6d90199-eb0c-4d5c-9e63-6fd5d1302838 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:30.703452 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c6d90199-eb0c-4d5c-9e63-6fd5d1302838 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:30.703901 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c6d90199-eb0c-4d5c-9e63-6fd5d1302838 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:30.704684 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c6d90199-eb0c-4d5c-9e63-6fd5d1302838 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:30.705184 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c6d90199-eb0c-4d5c-9e63-6fd5d1302838 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:30.734583 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c6d90199-eb0c-4d5c-9e63-6fd5d1302838 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042664 Jan 05 15:07:30.735134 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 517/1039] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Jan 5 15:07:30 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 15:07:32.053177 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9e540ec7-3689-4572-b1d7-11398b7923ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:32.053680 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9e540ec7-3689-4572-b1d7-11398b7923ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:32.060200 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e540ec7-3689-4572-b1d7-11398b7923ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:32.060646 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e540ec7-3689-4572-b1d7-11398b7923ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:32.061455 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e540ec7-3689-4572-b1d7-11398b7923ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:32.061912 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e540ec7-3689-4572-b1d7-11398b7923ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:32.086511 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9e540ec7-3689-4572-b1d7-11398b7923ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:07:32.362467 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9e540ec7-3689-4572-b1d7-11398b7923ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 204 len: 0 microversion: 2.1 time: 0.312639 Jan 05 15:07:32.363102 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 523/1040] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:07:32 2022] DELETE /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:07:32.370738 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-fdfc9777-f51d-4910-934d-831573233a5d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:32.371357 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-fdfc9777-f51d-4910-934d-831573233a5d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:32.377649 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fdfc9777-f51d-4910-934d-831573233a5d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:32.378100 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fdfc9777-f51d-4910-934d-831573233a5d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:32.378918 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fdfc9777-f51d-4910-934d-831573233a5d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:32.379359 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-fdfc9777-f51d-4910-934d-831573233a5d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:32.509334 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-fdfc9777-f51d-4910-934d-831573233a5d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:32.516776 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-fdfc9777-f51d-4910-934d-831573233a5d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1514 microversion: 2.1 time: 0.149648 Jan 05 15:07:32.517372 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 518/1041] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:32 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:33.534008 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dafb71e9-9953-498e-961b-ae99f42c4b58 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:33.534708 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dafb71e9-9953-498e-961b-ae99f42c4b58 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:33.540900 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dafb71e9-9953-498e-961b-ae99f42c4b58 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:33.541387 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dafb71e9-9953-498e-961b-ae99f42c4b58 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:33.542169 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dafb71e9-9953-498e-961b-ae99f42c4b58 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:33.542599 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dafb71e9-9953-498e-961b-ae99f42c4b58 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:33.676902 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-dafb71e9-9953-498e-961b-ae99f42c4b58 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:33.684203 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dafb71e9-9953-498e-961b-ae99f42c4b58 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1514 microversion: 2.1 time: 0.154882 Jan 05 15:07:33.684766 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 524/1042] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:33 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:34.700106 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2de4c32f-a0ec-472c-9e36-08c732aeb158 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:34.700650 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2de4c32f-a0ec-472c-9e36-08c732aeb158 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:34.706935 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2de4c32f-a0ec-472c-9e36-08c732aeb158 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:34.707383 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2de4c32f-a0ec-472c-9e36-08c732aeb158 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:34.708159 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2de4c32f-a0ec-472c-9e36-08c732aeb158 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:34.708591 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2de4c32f-a0ec-472c-9e36-08c732aeb158 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:34.836510 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-2de4c32f-a0ec-472c-9e36-08c732aeb158 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:34.843786 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2de4c32f-a0ec-472c-9e36-08c732aeb158 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1514 microversion: 2.1 time: 0.147460 Jan 05 15:07:34.844870 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 519/1043] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:34 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:35.861355 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-29e27f7d-1207-4667-bb07-4451e64e982a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:35.861959 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-29e27f7d-1207-4667-bb07-4451e64e982a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:35.868244 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29e27f7d-1207-4667-bb07-4451e64e982a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:35.868700 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29e27f7d-1207-4667-bb07-4451e64e982a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:35.869517 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29e27f7d-1207-4667-bb07-4451e64e982a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:35.869955 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29e27f7d-1207-4667-bb07-4451e64e982a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:35.997040 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-29e27f7d-1207-4667-bb07-4451e64e982a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:36.004986 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-29e27f7d-1207-4667-bb07-4451e64e982a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1514 microversion: 2.1 time: 0.147981 Jan 05 15:07:36.005582 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 525/1044] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:35 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:37.022185 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c1a4b80f-46d6-42dd-a299-834148e03e0e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:37.022823 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c1a4b80f-46d6-42dd-a299-834148e03e0e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:37.029030 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c1a4b80f-46d6-42dd-a299-834148e03e0e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:37.029506 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c1a4b80f-46d6-42dd-a299-834148e03e0e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:37.030286 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c1a4b80f-46d6-42dd-a299-834148e03e0e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:37.030718 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c1a4b80f-46d6-42dd-a299-834148e03e0e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:37.159152 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c1a4b80f-46d6-42dd-a299-834148e03e0e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:37.166555 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c1a4b80f-46d6-42dd-a299-834148e03e0e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1514 microversion: 2.1 time: 0.148209 Jan 05 15:07:37.167128 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 520/1045] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:37 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:37.447473 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-dfe08354-9fd1-49ea-ae52-ae5a0384aae6 req-683236f5-2c82-4851-8b9b-7003243bdffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb26e42e-5e97-4336-aa5c-20a7f5b439ed", "name": "network-vif-deleted", "tag": "32e08202-b8ca-4301-9648-36aacfa35c0a"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:07:37.449778 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:07:37.449778 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:07:37.457397 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-dfe08354-9fd1-49ea-ae52-ae5a0384aae6 req-683236f5-2c82-4851-8b9b-7003243bdffd service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:37.462320 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-dfe08354-9fd1-49ea-ae52-ae5a0384aae6 req-683236f5-2c82-4851-8b9b-7003243bdffd service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:37.469425 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-dfe08354-9fd1-49ea-ae52-ae5a0384aae6 req-683236f5-2c82-4851-8b9b-7003243bdffd service nova] Creating event network-vif-deleted:32e08202-b8ca-4301-9648-36aacfa35c0a for instance cb26e42e-5e97-4336-aa5c-20a7f5b439ed on hv-cinder-maste Jan 05 15:07:37.474364 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-dfe08354-9fd1-49ea-ae52-ae5a0384aae6 req-683236f5-2c82-4851-8b9b-7003243bdffd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030528 Jan 05 15:07:37.474965 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 526/1046] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:07:38.183733 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-ad535fd3-559e-4a14-9530-3f31edf3f22d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:38.184409 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-ad535fd3-559e-4a14-9530-3f31edf3f22d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:38.190847 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ad535fd3-559e-4a14-9530-3f31edf3f22d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:38.191402 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ad535fd3-559e-4a14-9530-3f31edf3f22d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:38.192262 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ad535fd3-559e-4a14-9530-3f31edf3f22d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:38.192773 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ad535fd3-559e-4a14-9530-3f31edf3f22d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:38.230407 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ad535fd3-559e-4a14-9530-3f31edf3f22d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:38.230858 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-ad535fd3-559e-4a14-9530-3f31edf3f22d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:38.231303 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-ad535fd3-559e-4a14-9530-3f31edf3f22d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lazy-loading 'fault' on Instance uuid cb26e42e-5e97-4336-aa5c-20a7f5b439ed {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:07:38.274376 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-ad535fd3-559e-4a14-9530-3f31edf3f22d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:38.282677 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-ad535fd3-559e-4a14-9530-3f31edf3f22d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 200 len: 1308 microversion: 2.1 time: 0.102147 Jan 05 15:07:38.283260 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 521/1047] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:38 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:39.301287 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bb3f5486-ed5b-4bab-b862-a3238db31aaf tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:39.301979 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bb3f5486-ed5b-4bab-b862-a3238db31aaf tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: cb26e42e-5e97-4336-aa5c-20a7f5b439ed] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:39.308124 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb3f5486-ed5b-4bab-b862-a3238db31aaf tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:39.308564 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb3f5486-ed5b-4bab-b862-a3238db31aaf tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:39.309353 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb3f5486-ed5b-4bab-b862-a3238db31aaf tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:39.309944 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb3f5486-ed5b-4bab-b862-a3238db31aaf tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:39.322705 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-bb3f5486-ed5b-4bab-b862-a3238db31aaf tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] HTTP exception thrown: Instance cb26e42e-5e97-4336-aa5c-20a7f5b439ed could not be found. Jan 05 15:07:39.324635 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bb3f5486-ed5b-4bab-b862-a3238db31aaf tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Returning 404 to user: Instance cb26e42e-5e97-4336-aa5c-20a7f5b439ed could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:07:39.324635 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bb3f5486-ed5b-4bab-b862-a3238db31aaf tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed" status: 404 len: 111 microversion: 2.1 time: 0.028004 Jan 05 15:07:39.324635 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 527/1048] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:39 2022] GET /compute/v2.1/servers/cb26e42e-5e97-4336-aa5c-20a7f5b439ed => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:07:40.633911 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d597b300-389a-4700-9479-8982811093e7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:40.634381 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d597b300-389a-4700-9479-8982811093e7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:40.640660 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d597b300-389a-4700-9479-8982811093e7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:40.641137 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d597b300-389a-4700-9479-8982811093e7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:40.641931 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d597b300-389a-4700-9479-8982811093e7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:40.642371 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d597b300-389a-4700-9479-8982811093e7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:40.671097 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d597b300-389a-4700-9479-8982811093e7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Going to try to terminate instance {{(pid=128789) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:07:41.023598 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d597b300-389a-4700-9479-8982811093e7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 204 len: 0 microversion: 2.1 time: 0.393180 Jan 05 15:07:41.024264 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 522/1049] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:07:40 2022] DELETE /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:07:41.032456 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f8662d93-b854-44f8-8139-5df82e90f496 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:41.033122 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f8662d93-b854-44f8-8139-5df82e90f496 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:41.039374 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8662d93-b854-44f8-8139-5df82e90f496 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:41.039851 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8662d93-b854-44f8-8139-5df82e90f496 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:41.040631 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8662d93-b854-44f8-8139-5df82e90f496 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:41.041089 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8662d93-b854-44f8-8139-5df82e90f496 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:41.184577 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-f8662d93-b854-44f8-8139-5df82e90f496 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:41.193180 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f8662d93-b854-44f8-8139-5df82e90f496 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 200 len: 1513 microversion: 2.1 time: 0.164429 Jan 05 15:07:41.193749 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 528/1050] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:41 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:42.211268 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-5f9f2a86-5df7-4492-b3a4-f0ebd69b9edf tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:42.211941 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-5f9f2a86-5df7-4492-b3a4-f0ebd69b9edf tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:42.218362 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5f9f2a86-5df7-4492-b3a4-f0ebd69b9edf tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:42.218810 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5f9f2a86-5df7-4492-b3a4-f0ebd69b9edf tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:42.219585 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5f9f2a86-5df7-4492-b3a4-f0ebd69b9edf tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:42.220021 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5f9f2a86-5df7-4492-b3a4-f0ebd69b9edf tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:42.347636 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-5f9f2a86-5df7-4492-b3a4-f0ebd69b9edf tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:42.355307 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-5f9f2a86-5df7-4492-b3a4-f0ebd69b9edf tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 200 len: 1513 microversion: 2.1 time: 0.148088 Jan 05 15:07:42.355949 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 523/1051] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:42 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:43.371234 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ac64f66d-5c84-4926-8a23-b4f8dcd00150 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:43.372483 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ac64f66d-5c84-4926-8a23-b4f8dcd00150 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:43.378506 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac64f66d-5c84-4926-8a23-b4f8dcd00150 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:43.378956 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac64f66d-5c84-4926-8a23-b4f8dcd00150 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:43.379731 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac64f66d-5c84-4926-8a23-b4f8dcd00150 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:43.380164 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac64f66d-5c84-4926-8a23-b4f8dcd00150 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:43.510932 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-ac64f66d-5c84-4926-8a23-b4f8dcd00150 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:43.519057 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ac64f66d-5c84-4926-8a23-b4f8dcd00150 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 200 len: 1513 microversion: 2.1 time: 0.151427 Jan 05 15:07:43.519635 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 529/1052] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:43 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:44.535649 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-afe25b7b-b47d-4654-895d-32bf4d5d8a7e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:44.536256 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-afe25b7b-b47d-4654-895d-32bf4d5d8a7e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:44.542583 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-afe25b7b-b47d-4654-895d-32bf4d5d8a7e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:44.543030 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-afe25b7b-b47d-4654-895d-32bf4d5d8a7e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:44.543845 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-afe25b7b-b47d-4654-895d-32bf4d5d8a7e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:44.544242 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-afe25b7b-b47d-4654-895d-32bf4d5d8a7e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:44.669515 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-afe25b7b-b47d-4654-895d-32bf4d5d8a7e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:44.677213 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-afe25b7b-b47d-4654-895d-32bf4d5d8a7e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 200 len: 1513 microversion: 2.1 time: 0.145360 Jan 05 15:07:44.677787 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 524/1053] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:44 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:45.704075 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9690901a-fa2b-41c8-a1bb-8782266157e3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:45.704075 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9690901a-fa2b-41c8-a1bb-8782266157e3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:45.704075 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9690901a-fa2b-41c8-a1bb-8782266157e3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:45.705300 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9690901a-fa2b-41c8-a1bb-8782266157e3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:45.705400 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-2381c641-2e0c-4848-b674-8ba520e7cb7e req-fd14e386-3823-4ce8-8fda-386e4676f7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0513327c-8038-49b0-a926-007e79f1c41c", "name": "network-vif-deleted", "tag": "b4ef5996-5211-497a-bab8-d83c88eea0df"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:07:45.705805 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9690901a-fa2b-41c8-a1bb-8782266157e3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:45.705932 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9690901a-fa2b-41c8-a1bb-8782266157e3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:45.708196 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:07:45.708196 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:07:45.716139 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-2381c641-2e0c-4848-b674-8ba520e7cb7e req-fd14e386-3823-4ce8-8fda-386e4676f7d2 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:45.716532 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-2381c641-2e0c-4848-b674-8ba520e7cb7e req-fd14e386-3823-4ce8-8fda-386e4676f7d2 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:45.728821 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-2381c641-2e0c-4848-b674-8ba520e7cb7e req-fd14e386-3823-4ce8-8fda-386e4676f7d2 service nova] Creating event network-vif-deleted:b4ef5996-5211-497a-bab8-d83c88eea0df for instance 0513327c-8038-49b0-a926-007e79f1c41c on hv-cinder-maste Jan 05 15:07:45.734045 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-2381c641-2e0c-4848-b674-8ba520e7cb7e req-fd14e386-3823-4ce8-8fda-386e4676f7d2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033815 Jan 05 15:07:45.734667 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 525/1054] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:07:45.770471 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-9690901a-fa2b-41c8-a1bb-8782266157e3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:45.778179 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9690901a-fa2b-41c8-a1bb-8782266157e3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 200 len: 1471 microversion: 2.1 time: 0.087286 Jan 05 15:07:45.778760 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 530/1055] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:45 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 1471 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:46.795427 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-058294eb-4aaf-47d7-8b00-c520f92cb078 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:46.796293 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-058294eb-4aaf-47d7-8b00-c520f92cb078 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:46.803053 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-058294eb-4aaf-47d7-8b00-c520f92cb078 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:46.803512 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-058294eb-4aaf-47d7-8b00-c520f92cb078 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:46.804300 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-058294eb-4aaf-47d7-8b00-c520f92cb078 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:46.804739 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-058294eb-4aaf-47d7-8b00-c520f92cb078 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:46.834767 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-058294eb-4aaf-47d7-8b00-c520f92cb078 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:46.837767 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-058294eb-4aaf-47d7-8b00-c520f92cb078 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:46.837767 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-058294eb-4aaf-47d7-8b00-c520f92cb078 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lazy-loading 'fault' on Instance uuid 0513327c-8038-49b0-a926-007e79f1c41c {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:07:46.878451 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-058294eb-4aaf-47d7-8b00-c520f92cb078 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:46.885640 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-058294eb-4aaf-47d7-8b00-c520f92cb078 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 200 len: 1308 microversion: 2.1 time: 0.094718 Jan 05 15:07:46.886117 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 526/1056] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:46 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:47.901543 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d9c55fe8-bae1-459e-91d3-3a15225067ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:47.902144 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d9c55fe8-bae1-459e-91d3-3a15225067ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: 0513327c-8038-49b0-a926-007e79f1c41c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:47.908411 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9c55fe8-bae1-459e-91d3-3a15225067ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:47.908846 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9c55fe8-bae1-459e-91d3-3a15225067ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:47.909636 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9c55fe8-bae1-459e-91d3-3a15225067ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:47.910059 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9c55fe8-bae1-459e-91d3-3a15225067ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:47.922707 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-d9c55fe8-bae1-459e-91d3-3a15225067ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] HTTP exception thrown: Instance 0513327c-8038-49b0-a926-007e79f1c41c could not be found. Jan 05 15:07:47.923294 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d9c55fe8-bae1-459e-91d3-3a15225067ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Returning 404 to user: Instance 0513327c-8038-49b0-a926-007e79f1c41c could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:07:47.924091 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d9c55fe8-bae1-459e-91d3-3a15225067ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c" status: 404 len: 111 microversion: 2.1 time: 0.026239 Jan 05 15:07:47.925111 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 531/1057] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:47 2022] GET /compute/v2.1/servers/0513327c-8038-49b0-a926-007e79f1c41c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:07:47.933302 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-883b2f53-2172-4abf-a43d-18d61e5fd056 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:47.933793 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-883b2f53-2172-4abf-a43d-18d61e5fd056 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:47.940864 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-883b2f53-2172-4abf-a43d-18d61e5fd056 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:47.941334 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-883b2f53-2172-4abf-a43d-18d61e5fd056 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:47.942111 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-883b2f53-2172-4abf-a43d-18d61e5fd056 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:47.942540 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-883b2f53-2172-4abf-a43d-18d61e5fd056 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:47.967082 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-883b2f53-2172-4abf-a43d-18d61e5fd056 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Going to try to terminate instance {{(pid=128789) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:07:48.326176 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-883b2f53-2172-4abf-a43d-18d61e5fd056 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 204 len: 0 microversion: 2.1 time: 0.396715 Jan 05 15:07:48.326984 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 527/1058] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:07:47 2022] DELETE /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:07:48.334870 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4cd3014b-1ab5-4163-b8d7-72e83d2137a8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:48.335491 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4cd3014b-1ab5-4163-b8d7-72e83d2137a8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:48.341420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cd3014b-1ab5-4163-b8d7-72e83d2137a8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:48.341867 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cd3014b-1ab5-4163-b8d7-72e83d2137a8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:48.342639 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cd3014b-1ab5-4163-b8d7-72e83d2137a8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:48.343072 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cd3014b-1ab5-4163-b8d7-72e83d2137a8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:48.475353 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4cd3014b-1ab5-4163-b8d7-72e83d2137a8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:48.482932 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4cd3014b-1ab5-4163-b8d7-72e83d2137a8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 200 len: 1513 microversion: 2.1 time: 0.151789 Jan 05 15:07:48.483507 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 532/1059] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:48 2022] GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:49.499875 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-862a020f-6bc0-4124-ae6e-e6d1168a03f7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:49.500607 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-862a020f-6bc0-4124-ae6e-e6d1168a03f7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:49.506900 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-862a020f-6bc0-4124-ae6e-e6d1168a03f7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:49.507349 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-862a020f-6bc0-4124-ae6e-e6d1168a03f7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:49.508132 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-862a020f-6bc0-4124-ae6e-e6d1168a03f7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:49.508566 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-862a020f-6bc0-4124-ae6e-e6d1168a03f7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:49.639199 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-862a020f-6bc0-4124-ae6e-e6d1168a03f7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:49.646679 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-862a020f-6bc0-4124-ae6e-e6d1168a03f7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 200 len: 1513 microversion: 2.1 time: 0.150892 Jan 05 15:07:49.647242 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 528/1060] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:49 2022] GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:50.424400 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ebfd46b6-1cd3-4d92-8af8-a6045d038072 req-ef3113b7-7598-4933-b3dc-03af3693930e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3239a6e-4795-47bb-8958-e38b87a60e0e", "name": "network-vif-deleted", "tag": "13cea986-c954-4f2a-80f4-f2a459e8a695"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:07:50.425906 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:07:50.425906 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:07:50.433403 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ebfd46b6-1cd3-4d92-8af8-a6045d038072 req-ef3113b7-7598-4933-b3dc-03af3693930e service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:50.435350 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ebfd46b6-1cd3-4d92-8af8-a6045d038072 req-ef3113b7-7598-4933-b3dc-03af3693930e service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:50.445396 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ebfd46b6-1cd3-4d92-8af8-a6045d038072 req-ef3113b7-7598-4933-b3dc-03af3693930e service nova] Creating event network-vif-deleted:13cea986-c954-4f2a-80f4-f2a459e8a695 for instance e3239a6e-4795-47bb-8958-e38b87a60e0e on hv-cinder-maste Jan 05 15:07:50.450424 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ebfd46b6-1cd3-4d92-8af8-a6045d038072 req-ef3113b7-7598-4933-b3dc-03af3693930e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029973 Jan 05 15:07:50.451033 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 533/1061] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:07:50.662738 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-612c6ac8-0281-4cc3-99ce-51a73f2f83a6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:50.663329 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-612c6ac8-0281-4cc3-99ce-51a73f2f83a6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:50.669616 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-612c6ac8-0281-4cc3-99ce-51a73f2f83a6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:50.670063 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-612c6ac8-0281-4cc3-99ce-51a73f2f83a6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:50.670837 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-612c6ac8-0281-4cc3-99ce-51a73f2f83a6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:50.671270 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-612c6ac8-0281-4cc3-99ce-51a73f2f83a6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:50.732437 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-612c6ac8-0281-4cc3-99ce-51a73f2f83a6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:50.741279 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-612c6ac8-0281-4cc3-99ce-51a73f2f83a6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 200 len: 1471 microversion: 2.1 time: 0.082058 Jan 05 15:07:50.742078 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 529/1062] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:50 2022] GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 1471 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:07:51.776055 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-06d73b75-990e-4473-b6d7-b59299de6e9f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:51.776757 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-06d73b75-990e-4473-b6d7-b59299de6e9f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: e3239a6e-4795-47bb-8958-e38b87a60e0e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:51.783069 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06d73b75-990e-4473-b6d7-b59299de6e9f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:51.783509 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06d73b75-990e-4473-b6d7-b59299de6e9f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:51.784287 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06d73b75-990e-4473-b6d7-b59299de6e9f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:51.784718 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06d73b75-990e-4473-b6d7-b59299de6e9f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:51.797690 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-06d73b75-990e-4473-b6d7-b59299de6e9f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] HTTP exception thrown: Instance e3239a6e-4795-47bb-8958-e38b87a60e0e could not be found. Jan 05 15:07:51.798269 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-06d73b75-990e-4473-b6d7-b59299de6e9f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Returning 404 to user: Instance e3239a6e-4795-47bb-8958-e38b87a60e0e could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:07:51.799146 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-06d73b75-990e-4473-b6d7-b59299de6e9f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e" status: 404 len: 111 microversion: 2.1 time: 0.027664 Jan 05 15:07:51.799703 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 534/1063] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:51 2022] GET /compute/v2.1/servers/e3239a6e-4795-47bb-8958-e38b87a60e0e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:07:53.088131 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:53.088658 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:53.094911 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:53.097664 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:53.097664 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:53.097664 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:53.120979 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Going to try to terminate instance {{(pid=128789) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:07:53.511319 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 204 len: 0 microversion: 2.1 time: 0.426521 Jan 05 15:07:53.511912 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 530/1064] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:07:53 2022] DELETE /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:07:53.520580 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b6dcd8ae-66c2-464f-a934-2acab77f4fb6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:53.521299 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b6dcd8ae-66c2-464f-a934-2acab77f4fb6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:53.530792 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6dcd8ae-66c2-464f-a934-2acab77f4fb6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:53.531507 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6dcd8ae-66c2-464f-a934-2acab77f4fb6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:53.532749 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6dcd8ae-66c2-464f-a934-2acab77f4fb6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:53.533501 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6dcd8ae-66c2-464f-a934-2acab77f4fb6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:53.995074 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b6dcd8ae-66c2-464f-a934-2acab77f4fb6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:54.002535 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b6dcd8ae-66c2-464f-a934-2acab77f4fb6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1513 microversion: 2.1 time: 0.486506 Jan 05 15:07:54.003098 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 535/1065] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:53 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1513 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:55.020481 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-0227a69c-6172-496c-8afd-38919fa5dd55 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:55.021211 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0227a69c-6172-496c-8afd-38919fa5dd55 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:55.027369 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0227a69c-6172-496c-8afd-38919fa5dd55 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:55.027832 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0227a69c-6172-496c-8afd-38919fa5dd55 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:55.028605 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0227a69c-6172-496c-8afd-38919fa5dd55 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:55.029032 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0227a69c-6172-496c-8afd-38919fa5dd55 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:55.159641 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-0227a69c-6172-496c-8afd-38919fa5dd55 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:55.167040 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-0227a69c-6172-496c-8afd-38919fa5dd55 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1513 microversion: 2.1 time: 0.151167 Jan 05 15:07:55.167608 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 531/1066] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:55 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:55.722575 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-02b51eb5-120b-44bb-8bd1-a478f82fb493 req-fc2e64ba-6834-4a20-ab5a-8e322a6ae061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c16547ce-867c-46c9-9117-9a3ff7f2b0e9", "name": "network-vif-deleted", "tag": "906a8d4e-ebf8-4e84-9c63-6111c3e36d6b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:07:55.724097 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:07:55.724097 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:07:55.731567 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-02b51eb5-120b-44bb-8bd1-a478f82fb493 req-fc2e64ba-6834-4a20-ab5a-8e322a6ae061 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:55.732011 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-02b51eb5-120b-44bb-8bd1-a478f82fb493 req-fc2e64ba-6834-4a20-ab5a-8e322a6ae061 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:55.743291 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-02b51eb5-120b-44bb-8bd1-a478f82fb493 req-fc2e64ba-6834-4a20-ab5a-8e322a6ae061 service nova] Creating event network-vif-deleted:906a8d4e-ebf8-4e84-9c63-6111c3e36d6b for instance c16547ce-867c-46c9-9117-9a3ff7f2b0e9 on hv-cinder-maste Jan 05 15:07:55.748154 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-02b51eb5-120b-44bb-8bd1-a478f82fb493 req-fc2e64ba-6834-4a20-ab5a-8e322a6ae061 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029785 Jan 05 15:07:55.748761 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 536/1067] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:07:56.183686 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6678ee1e-91ab-48e4-8a68-977ba34b0430 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:56.184299 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-6678ee1e-91ab-48e4-8a68-977ba34b0430 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:56.191115 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6678ee1e-91ab-48e4-8a68-977ba34b0430 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:56.191608 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6678ee1e-91ab-48e4-8a68-977ba34b0430 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:56.192583 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6678ee1e-91ab-48e4-8a68-977ba34b0430 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:56.193021 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6678ee1e-91ab-48e4-8a68-977ba34b0430 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:56.223847 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6678ee1e-91ab-48e4-8a68-977ba34b0430 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:56.224293 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6678ee1e-91ab-48e4-8a68-977ba34b0430 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:56.224735 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-6678ee1e-91ab-48e4-8a68-977ba34b0430 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lazy-loading 'fault' on Instance uuid c16547ce-867c-46c9-9117-9a3ff7f2b0e9 {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:07:56.262549 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-6678ee1e-91ab-48e4-8a68-977ba34b0430 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578e40c006442ca632381e242d35bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97821d0c0c79446abba323f103c8244a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:56.270459 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6678ee1e-91ab-48e4-8a68-977ba34b0430 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 200 len: 1308 microversion: 2.1 time: 0.090529 Jan 05 15:07:56.271202 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 532/1068] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:56 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:56.356160 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-495992625", "imageRef": "e4c11159-1e41-437a-af97-eb5f10704ae6", "flavorRef": "452", "networks": [{"uuid": "4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:07:56.404801 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] validate_networks() for [('4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 15:07:56.746880 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 15:07:56.747484 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 15:07:56.747746 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 15:07:56.748145 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 15:07:56.748654 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 15:07:56.758044 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:56.758478 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:56.759282 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:56.759732 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:56.776069 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Getting quotas for project 4ffa8c6fb14941c6ba03ddd2d63c49be. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:07:56.779956 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Getting quotas for user 7a8386858f994d4f9c29aaf040a539e0 and project 4ffa8c6fb14941c6ba03ddd2d63c49be. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:07:56.791112 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 15:07:56.793563 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4c11159-1e41-437a-af97-eb5f10704ae6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 15:07:56.898086 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545840 Jan 05 15:07:56.898737 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 537/1069] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 15:07:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 15:07:56.910000 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-14403e2a-eca2-4057-b990-572f15962e1d tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:56.910000 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-14403e2a-eca2-4057-b990-572f15962e1d tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:56.960152 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-14403e2a-eca2-4057-b990-572f15962e1d tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:56.966773 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-14403e2a-eca2-4057-b990-572f15962e1d tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 200 len: 1218 microversion: 2.1 time: 0.062130 Jan 05 15:07:56.967373 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 533/1070] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:56 2022] GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 1218 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:57.287279 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ff55de68-9956-4508-bab4-39811be04fbc tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:57.287828 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ff55de68-9956-4508-bab4-39811be04fbc tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] [instance: c16547ce-867c-46c9-9117-9a3ff7f2b0e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:57.294162 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff55de68-9956-4508-bab4-39811be04fbc tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:57.294717 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff55de68-9956-4508-bab4-39811be04fbc tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:57.295496 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff55de68-9956-4508-bab4-39811be04fbc tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:57.295933 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff55de68-9956-4508-bab4-39811be04fbc tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:57.309583 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-ff55de68-9956-4508-bab4-39811be04fbc tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] HTTP exception thrown: Instance c16547ce-867c-46c9-9117-9a3ff7f2b0e9 could not be found. Jan 05 15:07:57.313051 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ff55de68-9956-4508-bab4-39811be04fbc tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Returning 404 to user: Instance c16547ce-867c-46c9-9117-9a3ff7f2b0e9 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:07:57.313051 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ff55de68-9956-4508-bab4-39811be04fbc tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9" status: 404 len: 111 microversion: 2.1 time: 0.028075 Jan 05 15:07:57.313051 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 538/1071] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:57 2022] GET /compute/v2.1/servers/c16547ce-867c-46c9-9117-9a3ff7f2b0e9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:07:57.984307 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-594610eb-d4ad-4543-b113-78a44f0f0653 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:57.985170 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-594610eb-d4ad-4543-b113-78a44f0f0653 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:57.992354 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-594610eb-d4ad-4543-b113-78a44f0f0653 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:57.992804 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-594610eb-d4ad-4543-b113-78a44f0f0653 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:57.993883 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-594610eb-d4ad-4543-b113-78a44f0f0653 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:57.994212 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-594610eb-d4ad-4543-b113-78a44f0f0653 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:58.054324 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-594610eb-d4ad-4543-b113-78a44f0f0653 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:58.061662 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-594610eb-d4ad-4543-b113-78a44f0f0653 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 200 len: 1222 microversion: 2.1 time: 0.081065 Jan 05 15:07:58.062230 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 534/1072] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:57 2022] GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:07:59.080779 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-62123179-201f-4e57-9d36-43f9d19b2144 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:07:59.081517 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-62123179-201f-4e57-9d36-43f9d19b2144 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:07:59.088140 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62123179-201f-4e57-9d36-43f9d19b2144 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:59.088663 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62123179-201f-4e57-9d36-43f9d19b2144 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:59.089578 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62123179-201f-4e57-9d36-43f9d19b2144 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:07:59.090999 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62123179-201f-4e57-9d36-43f9d19b2144 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:07:59.157716 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-62123179-201f-4e57-9d36-43f9d19b2144 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:07:59.165827 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-62123179-201f-4e57-9d36-43f9d19b2144 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 200 len: 1270 microversion: 2.1 time: 0.089363 Jan 05 15:07:59.166426 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 539/1073] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:07:59 2022] GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:08:00.183028 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d76c0406-3365-47de-b6f7-db13ccb612e7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:00.183885 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d76c0406-3365-47de-b6f7-db13ccb612e7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:00.190370 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d76c0406-3365-47de-b6f7-db13ccb612e7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:00.190811 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d76c0406-3365-47de-b6f7-db13ccb612e7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:00.191586 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d76c0406-3365-47de-b6f7-db13ccb612e7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:00.192014 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d76c0406-3365-47de-b6f7-db13ccb612e7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:00.378141 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d76c0406-3365-47de-b6f7-db13ccb612e7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:08:00.385422 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d76c0406-3365-47de-b6f7-db13ccb612e7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 200 len: 1318 microversion: 2.1 time: 0.206317 Jan 05 15:08:00.385992 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 535/1074] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:00 2022] GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:08:00.903158 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-334fc096-118b-4942-be72-8aa26ed89fd3 req-735b07ac-389b-47e5-a2f6-06e3f3f41352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4", "tag": "e0bb8034-8d8b-416c-acf5-c75f60e6f363"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:08:00.908324 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:00.908324 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:08:00.927524 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-334fc096-118b-4942-be72-8aa26ed89fd3 req-735b07ac-389b-47e5-a2f6-06e3f3f41352 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:00.928183 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-334fc096-118b-4942-be72-8aa26ed89fd3 req-735b07ac-389b-47e5-a2f6-06e3f3f41352 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:00.940184 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-334fc096-118b-4942-be72-8aa26ed89fd3 req-735b07ac-389b-47e5-a2f6-06e3f3f41352 service nova] Creating event network-changed:e0bb8034-8d8b-416c-acf5-c75f60e6f363 for instance 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 on hv-cinder-maste Jan 05 15:08:00.944980 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-334fc096-118b-4942-be72-8aa26ed89fd3 req-735b07ac-389b-47e5-a2f6-06e3f3f41352 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053396 Jan 05 15:08:00.946151 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 540/1075] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:08:01.403122 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-0da5d266-f9a5-4804-9b69-6ba81ecde33a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:01.403734 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0da5d266-f9a5-4804-9b69-6ba81ecde33a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:01.411121 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0da5d266-f9a5-4804-9b69-6ba81ecde33a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:01.411573 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0da5d266-f9a5-4804-9b69-6ba81ecde33a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:01.412364 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0da5d266-f9a5-4804-9b69-6ba81ecde33a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:01.412830 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0da5d266-f9a5-4804-9b69-6ba81ecde33a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:01.676790 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-0da5d266-f9a5-4804-9b69-6ba81ecde33a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:08:01.684484 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-0da5d266-f9a5-4804-9b69-6ba81ecde33a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 200 len: 1318 microversion: 2.1 time: 0.284917 Jan 05 15:08:01.685087 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 536/1076] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:01 2022] GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:08:01.923917 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-452bd289-166d-4b97-b015-7993fd7001a6 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:01.924640 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-452bd289-166d-4b97-b015-7993fd7001a6 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:01.926446 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-dab96606-cbc1-40fa-9c57-5093a7b7b561 req-7a7fb0b6-0122-488a-ba10-00a90d53a99f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:08:01.928632 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:01.928632 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:08:01.931183 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-452bd289-166d-4b97-b015-7993fd7001a6 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:01.931831 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-452bd289-166d-4b97-b015-7993fd7001a6 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:01.932786 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-452bd289-166d-4b97-b015-7993fd7001a6 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:01.933240 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-452bd289-166d-4b97-b015-7993fd7001a6 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:01.938787 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-dab96606-cbc1-40fa-9c57-5093a7b7b561 req-7a7fb0b6-0122-488a-ba10-00a90d53a99f service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:01.941242 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-dab96606-cbc1-40fa-9c57-5093a7b7b561 req-7a7fb0b6-0122-488a-ba10-00a90d53a99f service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:01.950552 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-dab96606-cbc1-40fa-9c57-5093a7b7b561 req-7a7fb0b6-0122-488a-ba10-00a90d53a99f service nova] Creating event network-changed:b7c14da5-847f-4d0d-9e0e-5c9ad34c581c for instance 61994ccf-e8cd-41a1-aad1-c56ee0edd0af on hv-cinder-maste Jan 05 15:08:01.957247 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-dab96606-cbc1-40fa-9c57-5093a7b7b561 req-7a7fb0b6-0122-488a-ba10-00a90d53a99f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034442 Jan 05 15:08:01.958012 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 537/1077] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:08:01.963128 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-452bd289-166d-4b97-b015-7993fd7001a6 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:08:02.322574 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-452bd289-166d-4b97-b015-7993fd7001a6 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "DELETE /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 204 len: 0 microversion: 2.1 time: 0.402034 Jan 05 15:08:02.323346 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 541/1078] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:08:01 2022] DELETE /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:08:02.332387 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-bbe896b5-e1c3-4ceb-8400-9b388232791e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:02.333140 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-bbe896b5-e1c3-4ceb-8400-9b388232791e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:02.339435 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bbe896b5-e1c3-4ceb-8400-9b388232791e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:02.339890 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bbe896b5-e1c3-4ceb-8400-9b388232791e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:02.340670 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bbe896b5-e1c3-4ceb-8400-9b388232791e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:02.341121 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bbe896b5-e1c3-4ceb-8400-9b388232791e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:02.490805 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-bbe896b5-e1c3-4ceb-8400-9b388232791e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:08:02.499835 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-bbe896b5-e1c3-4ceb-8400-9b388232791e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1567 microversion: 2.1 time: 0.172100 Jan 05 15:08:02.501007 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 538/1079] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:02 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:08:02.701630 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-994165b7-662d-460e-9205-94c924bd5da9 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:02.702319 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-994165b7-662d-460e-9205-94c924bd5da9 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:02.708200 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-994165b7-662d-460e-9205-94c924bd5da9 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:02.708644 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-994165b7-662d-460e-9205-94c924bd5da9 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:02.709458 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-994165b7-662d-460e-9205-94c924bd5da9 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:02.709890 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-994165b7-662d-460e-9205-94c924bd5da9 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:02.842950 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-994165b7-662d-460e-9205-94c924bd5da9 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:08:02.850613 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-994165b7-662d-460e-9205-94c924bd5da9 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 200 len: 1318 microversion: 2.1 time: 0.152982 Jan 05 15:08:02.851528 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 542/1080] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:02 2022] GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:08:03.519137 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-de77d95f-f07e-478d-8d86-d1a37f5e6358 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:03.519752 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-de77d95f-f07e-478d-8d86-d1a37f5e6358 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:03.526307 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-de77d95f-f07e-478d-8d86-d1a37f5e6358 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:03.526763 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-de77d95f-f07e-478d-8d86-d1a37f5e6358 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:03.527558 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-de77d95f-f07e-478d-8d86-d1a37f5e6358 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:03.527998 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-de77d95f-f07e-478d-8d86-d1a37f5e6358 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:03.665246 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-de77d95f-f07e-478d-8d86-d1a37f5e6358 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:08:03.672500 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-de77d95f-f07e-478d-8d86-d1a37f5e6358 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1448 microversion: 2.1 time: 0.157682 Jan 05 15:08:03.673082 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 539/1081] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:03 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1448 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:08:03.867344 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6f50cebb-06eb-4ad3-a7e6-c94a1145aab0 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:03.867943 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6f50cebb-06eb-4ad3-a7e6-c94a1145aab0 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:03.874189 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f50cebb-06eb-4ad3-a7e6-c94a1145aab0 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:03.874631 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f50cebb-06eb-4ad3-a7e6-c94a1145aab0 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:03.875389 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f50cebb-06eb-4ad3-a7e6-c94a1145aab0 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:03.875816 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f50cebb-06eb-4ad3-a7e6-c94a1145aab0 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:04.009553 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6f50cebb-06eb-4ad3-a7e6-c94a1145aab0 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:08:04.017164 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6f50cebb-06eb-4ad3-a7e6-c94a1145aab0 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 200 len: 1318 microversion: 2.1 time: 0.153360 Jan 05 15:08:04.018435 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 543/1082] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:03 2022] GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:08:04.557748 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-c62664dd-c00f-4e94-840a-0be707f16ae0 req-db3dcb11-8f2d-4a11-847d-3c35707c6a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "name": "network-vif-deleted", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:08:04.559260 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:04.559260 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:08:04.566369 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-c62664dd-c00f-4e94-840a-0be707f16ae0 req-db3dcb11-8f2d-4a11-847d-3c35707c6a09 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:04.566807 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-c62664dd-c00f-4e94-840a-0be707f16ae0 req-db3dcb11-8f2d-4a11-847d-3c35707c6a09 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:04.577438 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-c62664dd-c00f-4e94-840a-0be707f16ae0 req-db3dcb11-8f2d-4a11-847d-3c35707c6a09 service nova] Creating event network-vif-deleted:b7c14da5-847f-4d0d-9e0e-5c9ad34c581c for instance 61994ccf-e8cd-41a1-aad1-c56ee0edd0af on hv-cinder-maste Jan 05 15:08:04.582077 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-c62664dd-c00f-4e94-840a-0be707f16ae0 req-db3dcb11-8f2d-4a11-847d-3c35707c6a09 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027910 Jan 05 15:08:04.582662 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 540/1083] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:08:04.689028 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c09e79e0-0e10-478f-b0f9-23662848505c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:04.689594 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c09e79e0-0e10-478f-b0f9-23662848505c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:04.695385 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c09e79e0-0e10-478f-b0f9-23662848505c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:04.697213 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c09e79e0-0e10-478f-b0f9-23662848505c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:04.697213 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c09e79e0-0e10-478f-b0f9-23662848505c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:04.697213 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c09e79e0-0e10-478f-b0f9-23662848505c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:04.759174 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-c09e79e0-0e10-478f-b0f9-23662848505c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:08:04.766842 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c09e79e0-0e10-478f-b0f9-23662848505c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1380 microversion: 2.1 time: 0.081635 Jan 05 15:08:04.767443 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 544/1084] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:04 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1380 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:08:05.035594 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-5b8bb793-b4d3-4452-aef6-0c3ad358ce6f tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:05.036301 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-5b8bb793-b4d3-4452-aef6-0c3ad358ce6f tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:05.042384 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5b8bb793-b4d3-4452-aef6-0c3ad358ce6f tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:05.042834 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5b8bb793-b4d3-4452-aef6-0c3ad358ce6f tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:05.043611 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5b8bb793-b4d3-4452-aef6-0c3ad358ce6f tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:05.046725 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-5b8bb793-b4d3-4452-aef6-0c3ad358ce6f tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:05.178734 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-5b8bb793-b4d3-4452-aef6-0c3ad358ce6f tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:08:05.186406 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-5b8bb793-b4d3-4452-aef6-0c3ad358ce6f tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 200 len: 1318 microversion: 2.1 time: 0.155768 Jan 05 15:08:05.186982 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 541/1085] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:05 2022] GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:08:05.783692 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b33dbed-291e-4be4-9872-fa48f640469d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:05.784298 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5b33dbed-291e-4be4-9872-fa48f640469d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:05.790668 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b33dbed-291e-4be4-9872-fa48f640469d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:05.793317 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b33dbed-291e-4be4-9872-fa48f640469d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:05.793317 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b33dbed-291e-4be4-9872-fa48f640469d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:05.793317 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b33dbed-291e-4be4-9872-fa48f640469d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:05.825741 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b33dbed-291e-4be4-9872-fa48f640469d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:05.825741 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b33dbed-291e-4be4-9872-fa48f640469d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:05.825741 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-5b33dbed-291e-4be4-9872-fa48f640469d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lazy-loading 'fault' on Instance uuid 61994ccf-e8cd-41a1-aad1-c56ee0edd0af {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:08:05.866258 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-5b33dbed-291e-4be4-9872-fa48f640469d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d3596bbc03474dafde93a63ea3e344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:08:05.874374 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5b33dbed-291e-4be4-9872-fa48f640469d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 200 len: 1223 microversion: 2.1 time: 0.094458 Jan 05 15:08:05.874950 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 545/1086] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:05 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:08:06.203348 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-09d7c319-4068-4602-bac3-6c80a5c650eb tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:06.204067 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-09d7c319-4068-4602-bac3-6c80a5c650eb tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:06.210398 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-09d7c319-4068-4602-bac3-6c80a5c650eb tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:06.210857 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-09d7c319-4068-4602-bac3-6c80a5c650eb tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:06.211602 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-09d7c319-4068-4602-bac3-6c80a5c650eb tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:06.212030 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-09d7c319-4068-4602-bac3-6c80a5c650eb tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:06.351488 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-09d7c319-4068-4602-bac3-6c80a5c650eb tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:08:06.352504 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-09d7c319-4068-4602-bac3-6c80a5c650eb tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 200 len: 1318 microversion: 2.1 time: 0.152791 Jan 05 15:08:06.353099 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 542/1087] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:06 2022] GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:08:06.892007 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2524a63-6a10-4858-bf76-06de2bf7c337 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:06.892771 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e2524a63-6a10-4858-bf76-06de2bf7c337 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] [instance: 61994ccf-e8cd-41a1-aad1-c56ee0edd0af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:06.901433 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2524a63-6a10-4858-bf76-06de2bf7c337 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:06.902008 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2524a63-6a10-4858-bf76-06de2bf7c337 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:06.902983 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2524a63-6a10-4858-bf76-06de2bf7c337 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:06.903536 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2524a63-6a10-4858-bf76-06de2bf7c337 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:06.919087 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-e2524a63-6a10-4858-bf76-06de2bf7c337 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] HTTP exception thrown: Instance 61994ccf-e8cd-41a1-aad1-c56ee0edd0af could not be found. Jan 05 15:08:06.919679 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2524a63-6a10-4858-bf76-06de2bf7c337 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Returning 404 to user: Instance 61994ccf-e8cd-41a1-aad1-c56ee0edd0af could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:08:06.920496 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e2524a63-6a10-4858-bf76-06de2bf7c337 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af" status: 404 len: 111 microversion: 2.1 time: 0.032534 Jan 05 15:08:06.921092 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 546/1088] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:06 2022] GET /compute/v2.1/servers/61994ccf-e8cd-41a1-aad1-c56ee0edd0af => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:08:07.221331 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6285c326-2f70-4e76-a926-8bea0c77697e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling method '.version_select at 0x7f217241e700>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:07.318639 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6285c326-2f70-4e76-a926-8bea0c77697e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-28527698" status: 202 len: 0 microversion: 2.1 time: 0.100714 Jan 05 15:08:07.322688 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 543/1089] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Jan 5 15:08:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-28527698 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:08:07.369375 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-52d08a36-2abb-4677-ac06-5c1712873e9b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:07.370048 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-52d08a36-2abb-4677-ac06-5c1712873e9b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:07.376209 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52d08a36-2abb-4677-ac06-5c1712873e9b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:07.376655 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52d08a36-2abb-4677-ac06-5c1712873e9b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:07.377469 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52d08a36-2abb-4677-ac06-5c1712873e9b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:07.378190 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52d08a36-2abb-4677-ac06-5c1712873e9b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:07.408166 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-b42b0ee3-bae2-45c3-a0a7-3cc3f27f605d req-cd8f3017-97d5-490a-94cb-5d8f52304d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4", "name": "network-vif-plugged", "status": "completed", "tag": "e0bb8034-8d8b-416c-acf5-c75f60e6f363"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:08:07.420051 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:07.420051 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:08:07.427959 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-b42b0ee3-bae2-45c3-a0a7-3cc3f27f605d req-cd8f3017-97d5-490a-94cb-5d8f52304d55 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:07.435021 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-b42b0ee3-bae2-45c3-a0a7-3cc3f27f605d req-cd8f3017-97d5-490a-94cb-5d8f52304d55 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:07.448536 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-b42b0ee3-bae2-45c3-a0a7-3cc3f27f605d req-cd8f3017-97d5-490a-94cb-5d8f52304d55 service nova] Creating event network-vif-plugged:e0bb8034-8d8b-416c-acf5-c75f60e6f363 for instance 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 on hv-cinder-maste Jan 05 15:08:07.454492 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-b42b0ee3-bae2-45c3-a0a7-3cc3f27f605d req-cd8f3017-97d5-490a-94cb-5d8f52304d55 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051255 Jan 05 15:08:07.455088 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 544/1090] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:08:07.643418 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-52d08a36-2abb-4677-ac06-5c1712873e9b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:08:07.651456 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-52d08a36-2abb-4677-ac06-5c1712873e9b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 200 len: 1318 microversion: 2.1 time: 0.285583 Jan 05 15:08:07.651955 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 547/1091] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:07 2022] GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:08:08.677141 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3634adb3-f412-4d90-9879-298cf7d44c31 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:08.678530 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3634adb3-f412-4d90-9879-298cf7d44c31 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:08.685584 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3634adb3-f412-4d90-9879-298cf7d44c31 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:08.686422 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3634adb3-f412-4d90-9879-298cf7d44c31 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:08.687548 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3634adb3-f412-4d90-9879-298cf7d44c31 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:08.688216 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3634adb3-f412-4d90-9879-298cf7d44c31 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:08.905225 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3634adb3-f412-4d90-9879-298cf7d44c31 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:08:08.912689 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3634adb3-f412-4d90-9879-298cf7d44c31 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 200 len: 1318 microversion: 2.1 time: 0.242908 Jan 05 15:08:08.913401 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 545/1092] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:08 2022] GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:08:09.930674 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c3f31be9-833c-441c-a8cc-df2af71f2ee2 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:09.931276 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c3f31be9-833c-441c-a8cc-df2af71f2ee2 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:09.938110 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3f31be9-833c-441c-a8cc-df2af71f2ee2 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:09.938673 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3f31be9-833c-441c-a8cc-df2af71f2ee2 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:09.939457 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3f31be9-833c-441c-a8cc-df2af71f2ee2 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:09.939888 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3f31be9-833c-441c-a8cc-df2af71f2ee2 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:10.084060 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-c3f31be9-833c-441c-a8cc-df2af71f2ee2 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:08:10.091699 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c3f31be9-833c-441c-a8cc-df2af71f2ee2 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 200 len: 1507 microversion: 2.1 time: 0.164847 Jan 05 15:08:10.105635 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 548/1093] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:09 2022] GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:08:25.598901 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6831272a-097a-402c-b8e9-5c331994de35 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d6ee7f7-cff9-43b7-8e4a-84e353a58649", "device": "/dev/sdb"}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:08:25.603592 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-6831272a-097a-402c-b8e9-5c331994de35 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:25.606725 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6831272a-097a-402c-b8e9-5c331994de35 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:25.607171 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6831272a-097a-402c-b8e9-5c331994de35 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:25.607952 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6831272a-097a-402c-b8e9-5c331994de35 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:25.608380 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6831272a-097a-402c-b8e9-5c331994de35 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:26.336650 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6831272a-097a-402c-b8e9-5c331994de35 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "POST /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.741300 Jan 05 15:08:26.337223 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 546/1094] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Jan 5 15:08:25 2022] POST /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4/os-volume_attachments => generated 194 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:08:51.317842 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0028b06d-29d7-418c-a063-026e7918c025 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:51.318495 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0028b06d-29d7-418c-a063-026e7918c025 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:51.324481 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0028b06d-29d7-418c-a063-026e7918c025 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:51.325783 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0028b06d-29d7-418c-a063-026e7918c025 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:51.327074 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0028b06d-29d7-418c-a063-026e7918c025 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:51.327566 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0028b06d-29d7-418c-a063-026e7918c025 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:51.409769 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-0028b06d-29d7-418c-a063-026e7918c025 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lazy-loading 'services' on Instance uuid 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:08:51.625023 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0028b06d-29d7-418c-a063-026e7918c025 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "DELETE /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4/os-volume_attachments/0d6ee7f7-cff9-43b7-8e4a-84e353a58649" status: 202 len: 0 microversion: 2.1 time: 0.310174 Jan 05 15:08:51.625656 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 549/1095] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Jan 5 15:08:51 2022] DELETE /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4/os-volume_attachments/0d6ee7f7-cff9-43b7-8e4a-84e353a58649 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:08:52.767888 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:52.768490 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:52.774959 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:52.780568 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:52.780568 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:52.780568 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:52.802656 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Going to try to terminate instance {{(pid=128789) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:08:53.190211 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "DELETE /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 204 len: 0 microversion: 2.1 time: 0.427232 Jan 05 15:08:53.190890 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 547/1096] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:08:52 2022] DELETE /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:08:53.200322 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-78f7bac6-64c8-422a-8f08-eef3d3631b4e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:53.201515 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-78f7bac6-64c8-422a-8f08-eef3d3631b4e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:53.208314 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78f7bac6-64c8-422a-8f08-eef3d3631b4e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:53.208774 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78f7bac6-64c8-422a-8f08-eef3d3631b4e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:53.209612 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78f7bac6-64c8-422a-8f08-eef3d3631b4e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:53.210234 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78f7bac6-64c8-422a-8f08-eef3d3631b4e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:53.443201 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-78f7bac6-64c8-422a-8f08-eef3d3631b4e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:08:53.450586 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-78f7bac6-64c8-422a-8f08-eef3d3631b4e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 200 len: 1513 microversion: 2.1 time: 0.255070 Jan 05 15:08:53.451153 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 550/1097] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:53 2022] GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:08:54.468281 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-632ea895-0781-4eca-a6f8-0067887b337e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:54.469716 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-632ea895-0781-4eca-a6f8-0067887b337e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:54.476340 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-632ea895-0781-4eca-a6f8-0067887b337e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:54.477146 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-632ea895-0781-4eca-a6f8-0067887b337e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:54.478164 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-632ea895-0781-4eca-a6f8-0067887b337e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:54.478808 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-632ea895-0781-4eca-a6f8-0067887b337e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:54.623406 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-632ea895-0781-4eca-a6f8-0067887b337e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:08:54.632454 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-632ea895-0781-4eca-a6f8-0067887b337e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 200 len: 1513 microversion: 2.1 time: 0.168194 Jan 05 15:08:54.642271 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 548/1098] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:54 2022] GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:08:55.655016 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b8b03706-f59d-4ad2-a241-fcec57deb7d3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:55.656335 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b8b03706-f59d-4ad2-a241-fcec57deb7d3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:55.664143 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8b03706-f59d-4ad2-a241-fcec57deb7d3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:55.668873 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8b03706-f59d-4ad2-a241-fcec57deb7d3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:55.668873 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8b03706-f59d-4ad2-a241-fcec57deb7d3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:55.668873 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8b03706-f59d-4ad2-a241-fcec57deb7d3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:55.785807 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b8b03706-f59d-4ad2-a241-fcec57deb7d3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:08:55.796369 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b8b03706-f59d-4ad2-a241-fcec57deb7d3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 200 len: 1471 microversion: 2.1 time: 0.149998 Jan 05 15:08:55.797484 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 551/1099] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:55 2022] GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:08:55.826237 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-8b289793-179f-414a-83c3-8d5338ff772d req-acccc299-e36a-4450-8bdb-ef3c42671696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4", "name": "network-vif-deleted", "tag": "e0bb8034-8d8b-416c-acf5-c75f60e6f363"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:08:55.828747 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:55.828747 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:08:55.836503 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-8b289793-179f-414a-83c3-8d5338ff772d req-acccc299-e36a-4450-8bdb-ef3c42671696 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:55.836943 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-8b289793-179f-414a-83c3-8d5338ff772d req-acccc299-e36a-4450-8bdb-ef3c42671696 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:55.849516 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-8b289793-179f-414a-83c3-8d5338ff772d req-acccc299-e36a-4450-8bdb-ef3c42671696 service nova] Creating event network-vif-deleted:e0bb8034-8d8b-416c-acf5-c75f60e6f363 for instance 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 on hv-cinder-maste Jan 05 15:08:55.854880 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-8b289793-179f-414a-83c3-8d5338ff772d req-acccc299-e36a-4450-8bdb-ef3c42671696 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033158 Jan 05 15:08:55.855504 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 549/1100] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:08:56.814013 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6fe5e75f-ff00-471d-b9a3-590df65704b3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:56.814679 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6fe5e75f-ff00-471d-b9a3-590df65704b3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:56.824073 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fe5e75f-ff00-471d-b9a3-590df65704b3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:56.824073 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fe5e75f-ff00-471d-b9a3-590df65704b3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:56.824073 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fe5e75f-ff00-471d-b9a3-590df65704b3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:56.824073 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fe5e75f-ff00-471d-b9a3-590df65704b3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:56.858755 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fe5e75f-ff00-471d-b9a3-590df65704b3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:56.859325 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fe5e75f-ff00-471d-b9a3-590df65704b3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:56.859990 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-6fe5e75f-ff00-471d-b9a3-590df65704b3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lazy-loading 'fault' on Instance uuid 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:08:57.193352 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-6fe5e75f-ff00-471d-b9a3-590df65704b3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:08:57.200831 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6fe5e75f-ff00-471d-b9a3-590df65704b3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 200 len: 1308 microversion: 2.1 time: 0.389774 Jan 05 15:08:57.204905 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 552/1101] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:56 2022] GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 1308 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:08:58.222394 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-24d3ec0b-e1d9-4d00-92ad-ec8d0bd32c53 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:08:58.223726 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-24d3ec0b-e1d9-4d00-92ad-ec8d0bd32c53 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:08:58.230627 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-24d3ec0b-e1d9-4d00-92ad-ec8d0bd32c53 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:58.231290 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-24d3ec0b-e1d9-4d00-92ad-ec8d0bd32c53 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:58.232241 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-24d3ec0b-e1d9-4d00-92ad-ec8d0bd32c53 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:08:58.232876 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-24d3ec0b-e1d9-4d00-92ad-ec8d0bd32c53 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:08:58.247451 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-24d3ec0b-e1d9-4d00-92ad-ec8d0bd32c53 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] HTTP exception thrown: Instance 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 could not be found. Jan 05 15:08:58.248174 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-24d3ec0b-e1d9-4d00-92ad-ec8d0bd32c53 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Returning 404 to user: Instance 80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:08:58.249264 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-24d3ec0b-e1d9-4d00-92ad-ec8d0bd32c53 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4" status: 404 len: 111 microversion: 2.1 time: 0.031368 Jan 05 15:08:58.249978 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 550/1102] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:08:58 2022] GET /compute/v2.1/servers/80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:08:59.243958 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8199e2bc-9787-48fa-b8c2-5ea8925eab12 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Action: 'create', calling method: .version_select at 0x7f2172ade5e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2013176654"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:08:59.262027 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-8199e2bc-9787-48fa-b8c2-5ea8925eab12 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Getting quotas for project 4ed05f9412d9477ea62f75cd05af148b. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:08:59.265820 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-8199e2bc-9787-48fa-b8c2-5ea8925eab12 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Getting quotas for user 86bfbcae996a457ebe52d8c2fb7bafe4 and project 4ed05f9412d9477ea62f75cd05af148b. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:08:59.471601 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-8199e2bc-9787-48fa-b8c2-5ea8925eab12 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Getting quotas for project 4ed05f9412d9477ea62f75cd05af148b. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:08:59.475501 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-8199e2bc-9787-48fa-b8c2-5ea8925eab12 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Getting quotas for user 86bfbcae996a457ebe52d8c2fb7bafe4 and project 4ed05f9412d9477ea62f75cd05af148b. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:08:59.488583 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8199e2bc-9787-48fa-b8c2-5ea8925eab12 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.406276 Jan 05 15:08:59.489199 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 553/1103] 10.222.0.30 () {60 vars in 1157 bytes} [Wed Jan 5 15:08:59 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:07.844718 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-0692c0fa-0375-447e-aeee-ebe537f0d319 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1025518513", "imageRef": "e4c11159-1e41-437a-af97-eb5f10704ae6", "flavorRef": "452", "networks": [{"uuid": "4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a"}]}} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:09:07.894067 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.network.neutron [None req-0692c0fa-0375-447e-aeee-ebe537f0d319 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] validate_networks() for [('4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a', None, None, None, None, None)] {{(pid=128789) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 15:09:08.241252 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-0692c0fa-0375-447e-aeee-ebe537f0d319 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Flavor limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 15:09:08.241704 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-0692c0fa-0375-447e-aeee-ebe537f0d319 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Image limits 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 15:09:08.242171 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-0692c0fa-0375-447e-aeee-ebe537f0d319 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Flavor pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 15:09:08.242576 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-0692c0fa-0375-447e-aeee-ebe537f0d319 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Image pref 0:0:0 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 15:09:08.242985 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.virt.hardware [None req-0692c0fa-0375-447e-aeee-ebe537f0d319 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 15:09:08.251574 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0692c0fa-0375-447e-aeee-ebe537f0d319 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:08.251960 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0692c0fa-0375-447e-aeee-ebe537f0d319 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:08.252764 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0692c0fa-0375-447e-aeee-ebe537f0d319 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:08.253230 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0692c0fa-0375-447e-aeee-ebe537f0d319 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:08.270064 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-0692c0fa-0375-447e-aeee-ebe537f0d319 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Getting quotas for project 4ffa8c6fb14941c6ba03ddd2d63c49be. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:09:08.275091 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.quota [None req-0692c0fa-0375-447e-aeee-ebe537f0d319 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Getting quotas for user 7a8386858f994d4f9c29aaf040a539e0 and project 4ffa8c6fb14941c6ba03ddd2d63c49be. Resources: {'instances', 'cores', 'ram'} {{(pid=128789) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:09:08.287393 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0692c0fa-0375-447e-aeee-ebe537f0d319 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Going to run 1 instances... {{(pid=128789) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 15:09:08.289764 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0692c0fa-0375-447e-aeee-ebe537f0d319 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4c11159-1e41-437a-af97-eb5f10704ae6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 15:09:08.425501 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-0692c0fa-0375-447e-aeee-ebe537f0d319 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584352 Jan 05 15:09:08.426142 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 551/1104] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 15:09:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 15:09:08.436260 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b9e44f38-fee0-4b4d-b508-dd80b1afab11 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:08.438237 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b9e44f38-fee0-4b4d-b508-dd80b1afab11 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:08.490540 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b9e44f38-fee0-4b4d-b508-dd80b1afab11 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:08.501283 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b9e44f38-fee0-4b4d-b508-dd80b1afab11 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73" status: 200 len: 1219 microversion: 2.1 time: 0.068993 Jan 05 15:09:08.509133 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 554/1105] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:08 2022] GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:09.518834 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7d86bcbe-d49a-41ab-9933-2c7429f503a7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:09.519415 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7d86bcbe-d49a-41ab-9933-2c7429f503a7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:09.525457 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7d86bcbe-d49a-41ab-9933-2c7429f503a7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:09.526384 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7d86bcbe-d49a-41ab-9933-2c7429f503a7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:09.526718 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7d86bcbe-d49a-41ab-9933-2c7429f503a7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:09.527149 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7d86bcbe-d49a-41ab-9933-2c7429f503a7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:09.584806 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-7d86bcbe-d49a-41ab-9933-2c7429f503a7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:09.592321 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7d86bcbe-d49a-41ab-9933-2c7429f503a7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73" status: 200 len: 1223 microversion: 2.1 time: 0.077614 Jan 05 15:09:09.592903 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 552/1106] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:09 2022] GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73 => generated 1223 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:10.609752 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e1e8c1f3-8f80-44c9-9d6b-7eb7e26c8e27 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:10.610687 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e1e8c1f3-8f80-44c9-9d6b-7eb7e26c8e27 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:10.617923 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1e8c1f3-8f80-44c9-9d6b-7eb7e26c8e27 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:10.618699 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1e8c1f3-8f80-44c9-9d6b-7eb7e26c8e27 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:10.619716 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1e8c1f3-8f80-44c9-9d6b-7eb7e26c8e27 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:10.620146 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1e8c1f3-8f80-44c9-9d6b-7eb7e26c8e27 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:10.685915 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e1e8c1f3-8f80-44c9-9d6b-7eb7e26c8e27 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:10.693695 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e1e8c1f3-8f80-44c9-9d6b-7eb7e26c8e27 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73" status: 200 len: 1279 microversion: 2.1 time: 0.087728 Jan 05 15:09:10.694266 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 555/1107] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:10 2022] GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73 => generated 1279 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:11.710865 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-bf744bba-b3d6-43ef-add1-52ca871578ca tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:11.711479 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-bf744bba-b3d6-43ef-add1-52ca871578ca tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:11.717757 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bf744bba-b3d6-43ef-add1-52ca871578ca tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:11.718203 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bf744bba-b3d6-43ef-add1-52ca871578ca tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:11.718967 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bf744bba-b3d6-43ef-add1-52ca871578ca tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:11.719401 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bf744bba-b3d6-43ef-add1-52ca871578ca tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:11.852691 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-bf744bba-b3d6-43ef-add1-52ca871578ca tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:11.863045 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-bf744bba-b3d6-43ef-add1-52ca871578ca tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73" status: 200 len: 1319 microversion: 2.1 time: 0.155868 Jan 05 15:09:11.863629 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 553/1108] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:11 2022] GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:12.130433 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-acc038ca-d06b-48bd-88c9-290109a6f3be req-3ca371b2-272d-4f7a-91b5-a40d0b545faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19df41f2-6b98-48a5-8198-d80388e39e73", "tag": "538500aa-927f-4d3d-978d-d6e32e769918"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:09:12.132015 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:09:12.132015 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:09:12.139539 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-acc038ca-d06b-48bd-88c9-290109a6f3be req-3ca371b2-272d-4f7a-91b5-a40d0b545faf service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:12.139985 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-acc038ca-d06b-48bd-88c9-290109a6f3be req-3ca371b2-272d-4f7a-91b5-a40d0b545faf service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:12.162397 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-acc038ca-d06b-48bd-88c9-290109a6f3be req-3ca371b2-272d-4f7a-91b5-a40d0b545faf service nova] Creating event network-changed:538500aa-927f-4d3d-978d-d6e32e769918 for instance 19df41f2-6b98-48a5-8198-d80388e39e73 on hv-cinder-maste Jan 05 15:09:12.167613 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-acc038ca-d06b-48bd-88c9-290109a6f3be req-3ca371b2-272d-4f7a-91b5-a40d0b545faf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041101 Jan 05 15:09:12.168198 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 556/1109] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:09:12.881465 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-d1fdec81-d33a-4c81-8172-0a3734e29f07 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:12.882096 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-d1fdec81-d33a-4c81-8172-0a3734e29f07 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:12.888270 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d1fdec81-d33a-4c81-8172-0a3734e29f07 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:12.895642 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d1fdec81-d33a-4c81-8172-0a3734e29f07 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:12.895642 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d1fdec81-d33a-4c81-8172-0a3734e29f07 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:12.895642 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-d1fdec81-d33a-4c81-8172-0a3734e29f07 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:13.019366 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-d1fdec81-d33a-4c81-8172-0a3734e29f07 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:13.027757 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-d1fdec81-d33a-4c81-8172-0a3734e29f07 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73" status: 200 len: 1319 microversion: 2.1 time: 0.148712 Jan 05 15:09:13.027757 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 554/1110] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:12 2022] GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:14.043977 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-820f5aa0-52d4-456e-a21e-5b476f574df3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:14.044661 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-820f5aa0-52d4-456e-a21e-5b476f574df3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:14.051091 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-820f5aa0-52d4-456e-a21e-5b476f574df3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:14.051536 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-820f5aa0-52d4-456e-a21e-5b476f574df3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:14.052297 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-820f5aa0-52d4-456e-a21e-5b476f574df3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:14.052723 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-820f5aa0-52d4-456e-a21e-5b476f574df3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:14.191207 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-820f5aa0-52d4-456e-a21e-5b476f574df3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:14.198858 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-820f5aa0-52d4-456e-a21e-5b476f574df3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73" status: 200 len: 1319 microversion: 2.1 time: 0.158825 Jan 05 15:09:14.199424 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 557/1111] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:14 2022] GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:15.221839 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-581ef3f1-481f-4096-8d69-84bcb2f2d069 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:15.222453 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-581ef3f1-481f-4096-8d69-84bcb2f2d069 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:15.228991 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-581ef3f1-481f-4096-8d69-84bcb2f2d069 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:15.229474 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-581ef3f1-481f-4096-8d69-84bcb2f2d069 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:15.230250 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-581ef3f1-481f-4096-8d69-84bcb2f2d069 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:15.230686 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-581ef3f1-481f-4096-8d69-84bcb2f2d069 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:15.355745 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-581ef3f1-481f-4096-8d69-84bcb2f2d069 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:15.362925 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-581ef3f1-481f-4096-8d69-84bcb2f2d069 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73" status: 200 len: 1319 microversion: 2.1 time: 0.145304 Jan 05 15:09:15.363525 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 555/1112] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:15 2022] GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:16.379431 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-191e7f7a-9f26-43c1-b3df-fac6be84a1bb tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:16.380033 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-191e7f7a-9f26-43c1-b3df-fac6be84a1bb tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:16.386219 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-191e7f7a-9f26-43c1-b3df-fac6be84a1bb tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:16.386660 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-191e7f7a-9f26-43c1-b3df-fac6be84a1bb tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:16.387424 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-191e7f7a-9f26-43c1-b3df-fac6be84a1bb tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:16.387847 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-191e7f7a-9f26-43c1-b3df-fac6be84a1bb tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:16.518468 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-191e7f7a-9f26-43c1-b3df-fac6be84a1bb tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:16.525983 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-191e7f7a-9f26-43c1-b3df-fac6be84a1bb tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73" status: 200 len: 1319 microversion: 2.1 time: 0.150106 Jan 05 15:09:16.526525 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 558/1113] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:16 2022] GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:09:17.542599 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1bee946a-d6f7-4b54-bb84-81bf87106db1 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:17.543236 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1bee946a-d6f7-4b54-bb84-81bf87106db1 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:17.549543 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1bee946a-d6f7-4b54-bb84-81bf87106db1 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:17.549989 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1bee946a-d6f7-4b54-bb84-81bf87106db1 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:17.550766 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1bee946a-d6f7-4b54-bb84-81bf87106db1 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:17.551232 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1bee946a-d6f7-4b54-bb84-81bf87106db1 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:17.684661 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-1bee946a-d6f7-4b54-bb84-81bf87106db1 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:17.691926 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1bee946a-d6f7-4b54-bb84-81bf87106db1 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73" status: 200 len: 1319 microversion: 2.1 time: 0.153015 Jan 05 15:09:17.692502 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 556/1114] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:17 2022] GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:17.828041 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1984590761", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2013176654", "security_groups": [{"name": "tempest-secgroup-smoke-369949876"}], "block_device_mapping_v2": [{"uuid": "02ae9194-273c-4971-8bd9-183cef8420b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2bf0812-1bb3-4cbd-8030-193c492fed7f"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:09:17.838344 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-d6a71394-1362-421d-b7cc-859c5f739bf7 req-977784d0-e81c-4bea-95da-cc021da6109c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19df41f2-6b98-48a5-8198-d80388e39e73", "name": "network-vif-plugged", "status": "completed", "tag": "538500aa-927f-4d3d-978d-d6e32e769918"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:09:17.839992 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:09:17.839992 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:09:17.847551 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-d6a71394-1362-421d-b7cc-859c5f739bf7 req-977784d0-e81c-4bea-95da-cc021da6109c service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:17.848103 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-d6a71394-1362-421d-b7cc-859c5f739bf7 req-977784d0-e81c-4bea-95da-cc021da6109c service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:17.859157 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-d6a71394-1362-421d-b7cc-859c5f739bf7 req-977784d0-e81c-4bea-95da-cc021da6109c service nova] Creating event network-vif-plugged:538500aa-927f-4d3d-978d-d6e32e769918 for instance 19df41f2-6b98-48a5-8198-d80388e39e73 on hv-cinder-maste Jan 05 15:09:17.864477 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-d6a71394-1362-421d-b7cc-859c5f739bf7 req-977784d0-e81c-4bea-95da-cc021da6109c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029660 Jan 05 15:09:17.865329 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 557/1115] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:09:17.942652 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] validate_networks() for [('b2bf0812-1bb3-4cbd-8030-193c492fed7f', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 15:09:18.351054 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 15:09:18.351549 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 15:09:18.352124 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 15:09:18.352699 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 15:09:18.353238 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 15:09:18.362195 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:18.362646 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:18.363467 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:18.363958 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:18.380559 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Getting quotas for project 4ed05f9412d9477ea62f75cd05af148b. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:09:18.384493 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Getting quotas for user 86bfbcae996a457ebe52d8c2fb7bafe4 and project 4ed05f9412d9477ea62f75cd05af148b. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:09:18.436738 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 15:09:18.439505 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='02ae9194-273c-4971-8bd9-183cef8420b0',volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 15:09:18.710503 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-0eec8315-b1d7-4664-a0da-17e13bbb9ecd tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:18.711275 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0eec8315-b1d7-4664-a0da-17e13bbb9ecd tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:18.717284 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0eec8315-b1d7-4664-a0da-17e13bbb9ecd tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:18.717729 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0eec8315-b1d7-4664-a0da-17e13bbb9ecd tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:18.718502 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0eec8315-b1d7-4664-a0da-17e13bbb9ecd tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:18.718963 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0eec8315-b1d7-4664-a0da-17e13bbb9ecd tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:18.842746 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.018400 Jan 05 15:09:18.843719 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 559/1116] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 15:09:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 15:09:18.847608 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-0eec8315-b1d7-4664-a0da-17e13bbb9ecd tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:18.853729 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-498530b9-5761-43f9-9288-f44c223744c1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:18.854343 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-498530b9-5761-43f9-9288-f44c223744c1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:18.855736 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-0eec8315-b1d7-4664-a0da-17e13bbb9ecd tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73" status: 200 len: 1319 microversion: 2.1 time: 0.151273 Jan 05 15:09:18.859077 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 558/1117] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:18 2022] GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:09:18.908242 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-498530b9-5761-43f9-9288-f44c223744c1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:18.914668 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-498530b9-5761-43f9-9288-f44c223744c1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1095 microversion: 2.1 time: 0.065234 Jan 05 15:09:18.915229 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 560/1118] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:18 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:09:19.871540 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1ab6e47f-bfc1-4bac-976f-1c18062be93c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:19.872178 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1ab6e47f-bfc1-4bac-976f-1c18062be93c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:19.879364 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1ab6e47f-bfc1-4bac-976f-1c18062be93c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:19.879814 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1ab6e47f-bfc1-4bac-976f-1c18062be93c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:19.880591 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1ab6e47f-bfc1-4bac-976f-1c18062be93c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:19.881025 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1ab6e47f-bfc1-4bac-976f-1c18062be93c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:19.930446 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3fd3d139-59db-4774-85cc-befaadafdbe4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:19.930971 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3fd3d139-59db-4774-85cc-befaadafdbe4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:19.937423 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fd3d139-59db-4774-85cc-befaadafdbe4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:19.937876 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fd3d139-59db-4774-85cc-befaadafdbe4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:19.938658 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fd3d139-59db-4774-85cc-befaadafdbe4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:19.939746 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fd3d139-59db-4774-85cc-befaadafdbe4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:19.997601 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3fd3d139-59db-4774-85cc-befaadafdbe4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:20.006446 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3fd3d139-59db-4774-85cc-befaadafdbe4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1145 microversion: 2.1 time: 0.079756 Jan 05 15:09:20.007066 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 561/1119] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:19 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:09:20.011586 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-1ab6e47f-bfc1-4bac-976f-1c18062be93c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:20.018980 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1ab6e47f-bfc1-4bac-976f-1c18062be93c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73" status: 200 len: 1508 microversion: 2.1 time: 0.151183 Jan 05 15:09:20.019535 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 559/1120] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:19 2022] GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:20.037812 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-58a35cfd-6095-4beb-b9d9-467d516dfe60 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e79383a4-b73e-47ce-a1ec-75202b6e6002", "device": "/dev/sdb"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:09:20.039420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-58a35cfd-6095-4beb-b9d9-467d516dfe60 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:20.045270 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58a35cfd-6095-4beb-b9d9-467d516dfe60 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:20.050754 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58a35cfd-6095-4beb-b9d9-467d516dfe60 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:20.050754 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58a35cfd-6095-4beb-b9d9-467d516dfe60 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:20.050754 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58a35cfd-6095-4beb-b9d9-467d516dfe60 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:20.790148 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-58a35cfd-6095-4beb-b9d9-467d516dfe60 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "POST /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.755976 Jan 05 15:09:20.790777 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 562/1121] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Jan 5 15:09:20 2022] POST /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73/os-volume_attachments => generated 194 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:09:21.023361 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-da4853f8-c6cc-406a-968a-d97bb706a5bc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:21.024062 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-da4853f8-c6cc-406a-968a-d97bb706a5bc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:21.030284 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-da4853f8-c6cc-406a-968a-d97bb706a5bc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:21.030726 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-da4853f8-c6cc-406a-968a-d97bb706a5bc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:21.031534 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-da4853f8-c6cc-406a-968a-d97bb706a5bc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:21.031996 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-da4853f8-c6cc-406a-968a-d97bb706a5bc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:21.094077 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-da4853f8-c6cc-406a-968a-d97bb706a5bc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:21.101755 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-da4853f8-c6cc-406a-968a-d97bb706a5bc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1193 microversion: 2.1 time: 0.082088 Jan 05 15:09:21.102323 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 560/1122] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:21 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:22.122145 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-94f3e618-6891-46bd-bef2-8a0438c59df1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:22.122876 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-94f3e618-6891-46bd-bef2-8a0438c59df1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:22.131072 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94f3e618-6891-46bd-bef2-8a0438c59df1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:22.132036 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94f3e618-6891-46bd-bef2-8a0438c59df1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:22.132827 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94f3e618-6891-46bd-bef2-8a0438c59df1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:22.133282 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94f3e618-6891-46bd-bef2-8a0438c59df1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:22.613224 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-94f3e618-6891-46bd-bef2-8a0438c59df1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:22.620375 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-94f3e618-6891-46bd-bef2-8a0438c59df1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1278 microversion: 2.1 time: 0.503145 Jan 05 15:09:22.620981 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 563/1123] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:22 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1278 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:23.077352 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-c8e0c6c4-5808-47c4-b985-e27efbd4db80 req-82f7d2c7-b414-4f1f-8946-2ae43a4eeb52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f6d3cac-1745-4d46-ba6c-7342079f99b8", "tag": "a33e7757-b68a-479b-83e9-2b37ebb10d65"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:09:23.080120 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:09:23.080120 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:09:23.087441 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-c8e0c6c4-5808-47c4-b985-e27efbd4db80 req-82f7d2c7-b414-4f1f-8946-2ae43a4eeb52 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:23.087878 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-c8e0c6c4-5808-47c4-b985-e27efbd4db80 req-82f7d2c7-b414-4f1f-8946-2ae43a4eeb52 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:23.112417 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-c8e0c6c4-5808-47c4-b985-e27efbd4db80 req-82f7d2c7-b414-4f1f-8946-2ae43a4eeb52 service nova] Creating event network-changed:a33e7757-b68a-479b-83e9-2b37ebb10d65 for instance 7f6d3cac-1745-4d46-ba6c-7342079f99b8 on hv-cinder-maste Jan 05 15:09:23.117764 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-c8e0c6c4-5808-47c4-b985-e27efbd4db80 req-82f7d2c7-b414-4f1f-8946-2ae43a4eeb52 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044776 Jan 05 15:09:23.118336 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 561/1124] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:09:23.637595 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a0913eba-2048-4034-8e61-44858f29b2d7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:23.638300 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a0913eba-2048-4034-8e61-44858f29b2d7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:23.644938 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0913eba-2048-4034-8e61-44858f29b2d7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:23.645520 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0913eba-2048-4034-8e61-44858f29b2d7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:23.646296 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0913eba-2048-4034-8e61-44858f29b2d7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:23.646720 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0913eba-2048-4034-8e61-44858f29b2d7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:23.865437 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-a0913eba-2048-4034-8e61-44858f29b2d7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:23.872558 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a0913eba-2048-4034-8e61-44858f29b2d7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1278 microversion: 2.1 time: 0.238766 Jan 05 15:09:23.873325 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 564/1125] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:23 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1278 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:24.889392 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-29bcab54-fb10-41a1-968e-75ac0ed53abe tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:24.890086 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-29bcab54-fb10-41a1-968e-75ac0ed53abe tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:24.896628 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-29bcab54-fb10-41a1-968e-75ac0ed53abe tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:24.897085 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-29bcab54-fb10-41a1-968e-75ac0ed53abe tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:24.897850 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-29bcab54-fb10-41a1-968e-75ac0ed53abe tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:24.898280 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-29bcab54-fb10-41a1-968e-75ac0ed53abe tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:25.074839 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-29bcab54-fb10-41a1-968e-75ac0ed53abe tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:25.082483 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-29bcab54-fb10-41a1-968e-75ac0ed53abe tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1278 microversion: 2.1 time: 0.197134 Jan 05 15:09:25.083043 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 562/1126] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:24 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1278 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:26.098622 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c8b35398-039e-49cb-b7c2-b66deeca815f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:26.099284 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c8b35398-039e-49cb-b7c2-b66deeca815f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:26.105803 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8b35398-039e-49cb-b7c2-b66deeca815f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:26.106248 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8b35398-039e-49cb-b7c2-b66deeca815f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:26.107030 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8b35398-039e-49cb-b7c2-b66deeca815f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:26.107462 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8b35398-039e-49cb-b7c2-b66deeca815f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:26.245024 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-c8b35398-039e-49cb-b7c2-b66deeca815f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:26.252284 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c8b35398-039e-49cb-b7c2-b66deeca815f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1278 microversion: 2.1 time: 0.157329 Jan 05 15:09:26.252842 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 565/1127] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:26 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:27.271712 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-16155127-9002-45e8-8dcf-886207562c6c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:27.274001 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-16155127-9002-45e8-8dcf-886207562c6c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:27.281564 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-16155127-9002-45e8-8dcf-886207562c6c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:27.282008 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-16155127-9002-45e8-8dcf-886207562c6c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:27.282818 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-16155127-9002-45e8-8dcf-886207562c6c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:27.283252 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-16155127-9002-45e8-8dcf-886207562c6c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:27.415252 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-16155127-9002-45e8-8dcf-886207562c6c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:27.422528 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-16155127-9002-45e8-8dcf-886207562c6c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1278 microversion: 2.1 time: 0.157590 Jan 05 15:09:27.423087 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 563/1128] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:27 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:28.438589 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3e785632-b0c3-436d-8679-c6814ea86669 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:28.439189 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3e785632-b0c3-436d-8679-c6814ea86669 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:28.445471 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e785632-b0c3-436d-8679-c6814ea86669 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:28.445917 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e785632-b0c3-436d-8679-c6814ea86669 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:28.446695 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e785632-b0c3-436d-8679-c6814ea86669 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:28.447123 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e785632-b0c3-436d-8679-c6814ea86669 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:28.578248 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3e785632-b0c3-436d-8679-c6814ea86669 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:28.585404 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3e785632-b0c3-436d-8679-c6814ea86669 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1278 microversion: 2.1 time: 0.150551 Jan 05 15:09:28.585977 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 566/1129] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:28 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:29.602008 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3eba42c6-9064-4efe-b0ab-d8490cd13711 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:29.602611 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3eba42c6-9064-4efe-b0ab-d8490cd13711 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:29.608804 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3eba42c6-9064-4efe-b0ab-d8490cd13711 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:29.609281 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3eba42c6-9064-4efe-b0ab-d8490cd13711 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:29.610041 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3eba42c6-9064-4efe-b0ab-d8490cd13711 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:29.610468 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-3eba42c6-9064-4efe-b0ab-d8490cd13711 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:29.742002 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3eba42c6-9064-4efe-b0ab-d8490cd13711 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:29.749166 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3eba42c6-9064-4efe-b0ab-d8490cd13711 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1278 microversion: 2.1 time: 0.151074 Jan 05 15:09:29.751651 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 564/1130] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:29 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:30.766091 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bc56b5ba-e875-4c57-8c76-3f36a37cf468 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:30.766677 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bc56b5ba-e875-4c57-8c76-3f36a37cf468 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:30.773555 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc56b5ba-e875-4c57-8c76-3f36a37cf468 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:30.773995 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc56b5ba-e875-4c57-8c76-3f36a37cf468 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:30.774767 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc56b5ba-e875-4c57-8c76-3f36a37cf468 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:30.775193 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc56b5ba-e875-4c57-8c76-3f36a37cf468 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:30.904451 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc56b5ba-e875-4c57-8c76-3f36a37cf468 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:30.911787 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bc56b5ba-e875-4c57-8c76-3f36a37cf468 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1278 microversion: 2.1 time: 0.149379 Jan 05 15:09:30.912294 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 567/1131] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:30 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:31.928062 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-8c0032af-fd18-4deb-a88b-97c0a8744570 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:31.928707 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-8c0032af-fd18-4deb-a88b-97c0a8744570 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:31.935153 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8c0032af-fd18-4deb-a88b-97c0a8744570 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:31.935622 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8c0032af-fd18-4deb-a88b-97c0a8744570 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:31.936390 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8c0032af-fd18-4deb-a88b-97c0a8744570 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:31.936818 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8c0032af-fd18-4deb-a88b-97c0a8744570 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:32.068168 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-8c0032af-fd18-4deb-a88b-97c0a8744570 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:32.075502 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-8c0032af-fd18-4deb-a88b-97c0a8744570 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1266 microversion: 2.1 time: 0.151697 Jan 05 15:09:32.076061 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 565/1132] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:31 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:09:33.091709 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2f1200bc-67d0-4d09-9df8-b431e8d38f1d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:33.092326 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2f1200bc-67d0-4d09-9df8-b431e8d38f1d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:33.098654 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f1200bc-67d0-4d09-9df8-b431e8d38f1d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:33.099095 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f1200bc-67d0-4d09-9df8-b431e8d38f1d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:33.100116 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f1200bc-67d0-4d09-9df8-b431e8d38f1d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:33.100601 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f1200bc-67d0-4d09-9df8-b431e8d38f1d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:33.235096 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-2f1200bc-67d0-4d09-9df8-b431e8d38f1d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:33.242467 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2f1200bc-67d0-4d09-9df8-b431e8d38f1d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1266 microversion: 2.1 time: 0.154680 Jan 05 15:09:33.247101 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 568/1133] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:33 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:34.259225 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-603a19e0-8e00-44dd-8a64-fcc8f1cc9d89 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:34.259837 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-603a19e0-8e00-44dd-8a64-fcc8f1cc9d89 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:34.266225 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-603a19e0-8e00-44dd-8a64-fcc8f1cc9d89 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:34.266678 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-603a19e0-8e00-44dd-8a64-fcc8f1cc9d89 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:34.267458 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-603a19e0-8e00-44dd-8a64-fcc8f1cc9d89 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:34.267896 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-603a19e0-8e00-44dd-8a64-fcc8f1cc9d89 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:34.398594 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-603a19e0-8e00-44dd-8a64-fcc8f1cc9d89 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:34.406036 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-603a19e0-8e00-44dd-8a64-fcc8f1cc9d89 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1266 microversion: 2.1 time: 0.150685 Jan 05 15:09:34.406601 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 566/1134] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:34 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:35.422830 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4030ad22-33ec-4a56-b479-931abecd457b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:35.423435 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4030ad22-33ec-4a56-b479-931abecd457b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:35.429924 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4030ad22-33ec-4a56-b479-931abecd457b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:35.430362 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4030ad22-33ec-4a56-b479-931abecd457b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:35.431121 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4030ad22-33ec-4a56-b479-931abecd457b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:35.431546 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4030ad22-33ec-4a56-b479-931abecd457b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:35.561176 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4030ad22-33ec-4a56-b479-931abecd457b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:35.568386 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4030ad22-33ec-4a56-b479-931abecd457b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1266 microversion: 2.1 time: 0.149207 Jan 05 15:09:35.568949 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 569/1135] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:35 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:36.584771 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6026743c-867f-4a69-857d-1982bdf8797e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:36.585435 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-6026743c-867f-4a69-857d-1982bdf8797e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:36.591693 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6026743c-867f-4a69-857d-1982bdf8797e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:36.592141 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6026743c-867f-4a69-857d-1982bdf8797e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:36.592908 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6026743c-867f-4a69-857d-1982bdf8797e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:36.593385 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6026743c-867f-4a69-857d-1982bdf8797e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:36.719879 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-6026743c-867f-4a69-857d-1982bdf8797e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:36.727891 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6026743c-867f-4a69-857d-1982bdf8797e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1266 microversion: 2.1 time: 0.146791 Jan 05 15:09:36.728448 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 567/1136] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:36 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:37.743491 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c7ee317e-56d7-4c4d-8268-3fa694e857b5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:37.744023 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c7ee317e-56d7-4c4d-8268-3fa694e857b5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:37.750219 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7ee317e-56d7-4c4d-8268-3fa694e857b5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:37.750774 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7ee317e-56d7-4c4d-8268-3fa694e857b5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:37.751471 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7ee317e-56d7-4c4d-8268-3fa694e857b5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:37.751899 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7ee317e-56d7-4c4d-8268-3fa694e857b5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:37.885372 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-c7ee317e-56d7-4c4d-8268-3fa694e857b5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:37.892662 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c7ee317e-56d7-4c4d-8268-3fa694e857b5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1266 microversion: 2.1 time: 0.152899 Jan 05 15:09:37.893263 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 570/1137] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:37 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:38.909134 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b11f36cd-11e3-498e-b6aa-e221a75b2fc5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:38.909740 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b11f36cd-11e3-498e-b6aa-e221a75b2fc5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:38.915975 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b11f36cd-11e3-498e-b6aa-e221a75b2fc5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:38.916441 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b11f36cd-11e3-498e-b6aa-e221a75b2fc5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:38.917246 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b11f36cd-11e3-498e-b6aa-e221a75b2fc5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:38.917679 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b11f36cd-11e3-498e-b6aa-e221a75b2fc5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:39.044994 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b11f36cd-11e3-498e-b6aa-e221a75b2fc5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:39.052158 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b11f36cd-11e3-498e-b6aa-e221a75b2fc5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1266 microversion: 2.1 time: 0.146735 Jan 05 15:09:39.052711 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 568/1138] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:38 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:40.068459 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7ec0f95a-8695-4b05-b046-3f05080cb310 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:40.069736 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7ec0f95a-8695-4b05-b046-3f05080cb310 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:40.076560 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ec0f95a-8695-4b05-b046-3f05080cb310 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:40.077213 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ec0f95a-8695-4b05-b046-3f05080cb310 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:40.077994 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ec0f95a-8695-4b05-b046-3f05080cb310 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:40.078420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ec0f95a-8695-4b05-b046-3f05080cb310 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:40.233292 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-7ec0f95a-8695-4b05-b046-3f05080cb310 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:40.240748 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7ec0f95a-8695-4b05-b046-3f05080cb310 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1266 microversion: 2.1 time: 0.175977 Jan 05 15:09:40.249702 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 571/1139] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:40 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:40.677336 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6b5b4270-0cac-4af0-8e72-7e1a891fa093 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:40.677841 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-6b5b4270-0cac-4af0-8e72-7e1a891fa093 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:40.683972 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6b5b4270-0cac-4af0-8e72-7e1a891fa093 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:40.684415 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6b5b4270-0cac-4af0-8e72-7e1a891fa093 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:40.685212 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6b5b4270-0cac-4af0-8e72-7e1a891fa093 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:40.685631 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6b5b4270-0cac-4af0-8e72-7e1a891fa093 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:40.761350 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-6b5b4270-0cac-4af0-8e72-7e1a891fa093 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lazy-loading 'services' on Instance uuid 19df41f2-6b98-48a5-8198-d80388e39e73 {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:09:40.998817 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6b5b4270-0cac-4af0-8e72-7e1a891fa093 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "DELETE /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73/os-volume_attachments/e79383a4-b73e-47ce-a1ec-75202b6e6002" status: 202 len: 0 microversion: 2.1 time: 0.324967 Jan 05 15:09:40.999409 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 569/1140] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Jan 5 15:09:40 2022] DELETE /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73/os-volume_attachments/e79383a4-b73e-47ce-a1ec-75202b6e6002 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 15:09:41.257366 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f3822ac1-a604-423f-8dc3-8ff73a5885ef tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:41.257958 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f3822ac1-a604-423f-8dc3-8ff73a5885ef tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:41.264267 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3822ac1-a604-423f-8dc3-8ff73a5885ef tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:41.264710 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3822ac1-a604-423f-8dc3-8ff73a5885ef tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:41.265507 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3822ac1-a604-423f-8dc3-8ff73a5885ef tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:41.265932 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3822ac1-a604-423f-8dc3-8ff73a5885ef tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:41.395407 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-f3822ac1-a604-423f-8dc3-8ff73a5885ef tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:41.402544 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f3822ac1-a604-423f-8dc3-8ff73a5885ef tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1266 microversion: 2.1 time: 0.149314 Jan 05 15:09:41.403100 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 572/1141] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:41 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:42.071209 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-425d01d0-4bd8-4182-b125-3533479911c5 req-20db0dae-90db-425c-9fa5-bfcc62b1e1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f6d3cac-1745-4d46-ba6c-7342079f99b8", "name": "network-vif-plugged", "status": "completed", "tag": "a33e7757-b68a-479b-83e9-2b37ebb10d65"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:09:42.073373 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:09:42.073373 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:09:42.081883 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-425d01d0-4bd8-4182-b125-3533479911c5 req-20db0dae-90db-425c-9fa5-bfcc62b1e1e8 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:42.082599 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-425d01d0-4bd8-4182-b125-3533479911c5 req-20db0dae-90db-425c-9fa5-bfcc62b1e1e8 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:42.093258 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-425d01d0-4bd8-4182-b125-3533479911c5 req-20db0dae-90db-425c-9fa5-bfcc62b1e1e8 service nova] Creating event network-vif-plugged:a33e7757-b68a-479b-83e9-2b37ebb10d65 for instance 7f6d3cac-1745-4d46-ba6c-7342079f99b8 on hv-cinder-maste Jan 05 15:09:42.100958 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-425d01d0-4bd8-4182-b125-3533479911c5 req-20db0dae-90db-425c-9fa5-bfcc62b1e1e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034037 Jan 05 15:09:42.101661 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 570/1142] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:09:42.106085 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2c5c1a60-4e26-467e-a060-8e691f74eb27 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:42.106587 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2c5c1a60-4e26-467e-a060-8e691f74eb27 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:42.112718 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c5c1a60-4e26-467e-a060-8e691f74eb27 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:42.113884 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c5c1a60-4e26-467e-a060-8e691f74eb27 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:42.114670 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c5c1a60-4e26-467e-a060-8e691f74eb27 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:42.115105 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c5c1a60-4e26-467e-a060-8e691f74eb27 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:42.140956 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2c5c1a60-4e26-467e-a060-8e691f74eb27 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:09:42.419987 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1779ed7e-6105-416e-8346-bb5264fd6e48 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:42.420433 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1779ed7e-6105-416e-8346-bb5264fd6e48 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:42.426471 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1779ed7e-6105-416e-8346-bb5264fd6e48 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:42.426932 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1779ed7e-6105-416e-8346-bb5264fd6e48 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:42.427699 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1779ed7e-6105-416e-8346-bb5264fd6e48 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:42.428130 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1779ed7e-6105-416e-8346-bb5264fd6e48 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:42.561782 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-1779ed7e-6105-416e-8346-bb5264fd6e48 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:42.563301 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2c5c1a60-4e26-467e-a060-8e691f74eb27 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "DELETE /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73" status: 204 len: 0 microversion: 2.1 time: 0.460680 Jan 05 15:09:42.564035 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 573/1143] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:09:42 2022] DELETE /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 05 15:09:42.569719 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1779ed7e-6105-416e-8346-bb5264fd6e48 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1266 microversion: 2.1 time: 0.153901 Jan 05 15:09:42.570300 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 571/1144] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:42 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:09:42.572247 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c5d58d5b-fa1b-4520-96fc-424811f03d81 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:42.572767 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c5d58d5b-fa1b-4520-96fc-424811f03d81 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:42.578566 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5d58d5b-fa1b-4520-96fc-424811f03d81 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:42.579007 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5d58d5b-fa1b-4520-96fc-424811f03d81 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:42.579792 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5d58d5b-fa1b-4520-96fc-424811f03d81 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:42.580225 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5d58d5b-fa1b-4520-96fc-424811f03d81 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:42.711333 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-c5d58d5b-fa1b-4520-96fc-424811f03d81 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:42.718566 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c5d58d5b-fa1b-4520-96fc-424811f03d81 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73" status: 200 len: 1514 microversion: 2.1 time: 0.150241 Jan 05 15:09:42.719077 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 574/1145] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:42 2022] GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:09:43.586890 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-6b689634-a6de-4a9e-a79a-94e4c5875921 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:43.587510 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-6b689634-a6de-4a9e-a79a-94e4c5875921 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:43.593487 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6b689634-a6de-4a9e-a79a-94e4c5875921 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:43.597862 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6b689634-a6de-4a9e-a79a-94e4c5875921 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:43.597862 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6b689634-a6de-4a9e-a79a-94e4c5875921 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:43.597862 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-6b689634-a6de-4a9e-a79a-94e4c5875921 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:43.723782 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-6b689634-a6de-4a9e-a79a-94e4c5875921 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:43.731352 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-6b689634-a6de-4a9e-a79a-94e4c5875921 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1266 microversion: 2.1 time: 0.148141 Jan 05 15:09:43.732112 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 572/1146] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:43 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:43.735253 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b0c81dc7-2153-425e-a5c0-5cf4b1ad7803 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:43.735891 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b0c81dc7-2153-425e-a5c0-5cf4b1ad7803 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:43.742565 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0c81dc7-2153-425e-a5c0-5cf4b1ad7803 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:43.743343 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0c81dc7-2153-425e-a5c0-5cf4b1ad7803 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:43.743884 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0c81dc7-2153-425e-a5c0-5cf4b1ad7803 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:43.744313 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0c81dc7-2153-425e-a5c0-5cf4b1ad7803 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:43.878970 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b0c81dc7-2153-425e-a5c0-5cf4b1ad7803 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:43.886226 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b0c81dc7-2153-425e-a5c0-5cf4b1ad7803 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73" status: 200 len: 1514 microversion: 2.1 time: 0.154520 Jan 05 15:09:43.886790 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 575/1147] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:43 2022] GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:09:44.748291 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-70b25623-de28-4ccb-a7ce-ba3cef792bae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:44.748915 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-70b25623-de28-4ccb-a7ce-ba3cef792bae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:44.755628 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-70b25623-de28-4ccb-a7ce-ba3cef792bae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:44.756069 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-70b25623-de28-4ccb-a7ce-ba3cef792bae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:44.756833 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-70b25623-de28-4ccb-a7ce-ba3cef792bae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:44.757303 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-70b25623-de28-4ccb-a7ce-ba3cef792bae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:44.901689 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-70b25623-de28-4ccb-a7ce-ba3cef792bae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:44.903785 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3e412d9c-0476-4b6e-8321-0ddedff78e2c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:44.904325 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3e412d9c-0476-4b6e-8321-0ddedff78e2c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:44.909406 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-70b25623-de28-4ccb-a7ce-ba3cef792bae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1451 microversion: 2.1 time: 0.164755 Jan 05 15:09:44.910693 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 573/1148] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:44 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:09:44.912008 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e412d9c-0476-4b6e-8321-0ddedff78e2c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:44.912525 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e412d9c-0476-4b6e-8321-0ddedff78e2c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:44.915410 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e412d9c-0476-4b6e-8321-0ddedff78e2c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:44.915932 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e412d9c-0476-4b6e-8321-0ddedff78e2c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:44.927350 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-49777fb2-6387-4ce7-98ae-08f4bbf4ffb4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:44.927965 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-49777fb2-6387-4ce7-98ae-08f4bbf4ffb4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:44.933813 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-49777fb2-6387-4ce7-98ae-08f4bbf4ffb4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:44.934889 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-49777fb2-6387-4ce7-98ae-08f4bbf4ffb4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:44.935168 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-49777fb2-6387-4ce7-98ae-08f4bbf4ffb4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:44.935604 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-49777fb2-6387-4ce7-98ae-08f4bbf4ffb4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:45.065909 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-49777fb2-6387-4ce7-98ae-08f4bbf4ffb4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:45.073203 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-49777fb2-6387-4ce7-98ae-08f4bbf4ffb4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1451 microversion: 2.1 time: 0.151113 Jan 05 15:09:45.073776 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 574/1149] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:44 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:09:45.133113 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-3e412d9c-0476-4b6e-8321-0ddedff78e2c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:45.140532 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3e412d9c-0476-4b6e-8321-0ddedff78e2c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73" status: 200 len: 1514 microversion: 2.1 time: 0.240547 Jan 05 15:09:45.141398 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 576/1150] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:44 2022] GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73 => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:45.402879 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-36b59fea-ff0c-4e08-805d-6adb31dca6d6 req-7e8d48db-e95f-486f-aa90-a2a1c6ad8d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19df41f2-6b98-48a5-8198-d80388e39e73", "name": "network-vif-deleted", "tag": "538500aa-927f-4d3d-978d-d6e32e769918"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:09:45.408288 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:09:45.408288 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:09:45.412292 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-36b59fea-ff0c-4e08-805d-6adb31dca6d6 req-7e8d48db-e95f-486f-aa90-a2a1c6ad8d2a service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:45.412738 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-36b59fea-ff0c-4e08-805d-6adb31dca6d6 req-7e8d48db-e95f-486f-aa90-a2a1c6ad8d2a service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:45.423911 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-36b59fea-ff0c-4e08-805d-6adb31dca6d6 req-7e8d48db-e95f-486f-aa90-a2a1c6ad8d2a service nova] Creating event network-vif-deleted:538500aa-927f-4d3d-978d-d6e32e769918 for instance 19df41f2-6b98-48a5-8198-d80388e39e73 on hv-cinder-maste Jan 05 15:09:45.429096 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-36b59fea-ff0c-4e08-805d-6adb31dca6d6 req-7e8d48db-e95f-486f-aa90-a2a1c6ad8d2a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030473 Jan 05 15:09:45.429788 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 575/1151] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:09:46.157148 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa788907-0cd3-4b51-b8bc-4f372b9e1347 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:46.157759 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa788907-0cd3-4b51-b8bc-4f372b9e1347 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:46.164067 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa788907-0cd3-4b51-b8bc-4f372b9e1347 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:46.164619 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa788907-0cd3-4b51-b8bc-4f372b9e1347 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:46.165319 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa788907-0cd3-4b51-b8bc-4f372b9e1347 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:46.165750 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa788907-0cd3-4b51-b8bc-4f372b9e1347 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:46.196870 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa788907-0cd3-4b51-b8bc-4f372b9e1347 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:46.197467 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa788907-0cd3-4b51-b8bc-4f372b9e1347 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:46.197855 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-aa788907-0cd3-4b51-b8bc-4f372b9e1347 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lazy-loading 'fault' on Instance uuid 19df41f2-6b98-48a5-8198-d80388e39e73 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:09:46.235472 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-aa788907-0cd3-4b51-b8bc-4f372b9e1347 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8386858f994d4f9c29aaf040a539e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:09:46.243229 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aa788907-0cd3-4b51-b8bc-4f372b9e1347 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73" status: 200 len: 1309 microversion: 2.1 time: 0.089812 Jan 05 15:09:46.243852 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 577/1152] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:46 2022] GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73 => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:09:47.143221 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-c82dddc6-d53b-4b6e-aa6e-b4099246ec0e req-33bc5f82-5154-460f-9862-47496883c9ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f6d3cac-1745-4d46-ba6c-7342079f99b8", "tag": "a33e7757-b68a-479b-83e9-2b37ebb10d65"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:09:47.148628 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:09:47.148628 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:09:47.153398 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-c82dddc6-d53b-4b6e-aa6e-b4099246ec0e req-33bc5f82-5154-460f-9862-47496883c9ad service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:47.153857 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-c82dddc6-d53b-4b6e-aa6e-b4099246ec0e req-33bc5f82-5154-460f-9862-47496883c9ad service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:47.165779 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-c82dddc6-d53b-4b6e-aa6e-b4099246ec0e req-33bc5f82-5154-460f-9862-47496883c9ad service nova] Creating event network-changed:a33e7757-b68a-479b-83e9-2b37ebb10d65 for instance 7f6d3cac-1745-4d46-ba6c-7342079f99b8 on hv-cinder-maste Jan 05 15:09:47.173223 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-c82dddc6-d53b-4b6e-aa6e-b4099246ec0e req-33bc5f82-5154-460f-9862-47496883c9ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033557 Jan 05 15:09:47.175246 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 576/1153] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:09:47.260185 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f0190752-6c63-4f8d-96d4-fc96c628a85b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:09:47.260898 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f0190752-6c63-4f8d-96d4-fc96c628a85b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] [instance: 19df41f2-6b98-48a5-8198-d80388e39e73] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:09:47.267279 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0190752-6c63-4f8d-96d4-fc96c628a85b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:47.267744 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0190752-6c63-4f8d-96d4-fc96c628a85b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:47.268595 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0190752-6c63-4f8d-96d4-fc96c628a85b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:09:47.269686 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0190752-6c63-4f8d-96d4-fc96c628a85b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:09:47.283042 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f0190752-6c63-4f8d-96d4-fc96c628a85b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] HTTP exception thrown: Instance 19df41f2-6b98-48a5-8198-d80388e39e73 could not be found. Jan 05 15:09:47.283727 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f0190752-6c63-4f8d-96d4-fc96c628a85b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Returning 404 to user: Instance 19df41f2-6b98-48a5-8198-d80388e39e73 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:09:47.284592 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f0190752-6c63-4f8d-96d4-fc96c628a85b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73" status: 404 len: 111 microversion: 2.1 time: 0.028335 Jan 05 15:09:47.285392 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 578/1154] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:09:47 2022] GET /compute/v2.1/servers/19df41f2-6b98-48a5-8198-d80388e39e73 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:11:16.616694 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 15:11:16.617262 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: Wed Jan 5 15:11:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 15:11:42.508858 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-0bf06a66-6122-4ca5-ba84-eeae1176b050 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:11:42.509539 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0bf06a66-6122-4ca5-ba84-eeae1176b050 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:11:42.515754 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0bf06a66-6122-4ca5-ba84-eeae1176b050 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:42.516198 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0bf06a66-6122-4ca5-ba84-eeae1176b050 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:42.517743 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0bf06a66-6122-4ca5-ba84-eeae1176b050 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:42.518178 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-0bf06a66-6122-4ca5-ba84-eeae1176b050 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:42.541729 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-0bf06a66-6122-4ca5-ba84-eeae1176b050 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Going to try to terminate instance {{(pid=128789) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:11:42.831144 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-0bf06a66-6122-4ca5-ba84-eeae1176b050 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 204 len: 0 microversion: 2.1 time: 0.327378 Jan 05 15:11:42.831649 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 577/1155] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:11:42 2022] DELETE /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:11:42.840362 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-506a0a8e-9ce4-499d-95ad-b06d0797bed6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:11:42.840964 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-506a0a8e-9ce4-499d-95ad-b06d0797bed6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:11:42.846744 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-506a0a8e-9ce4-499d-95ad-b06d0797bed6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:42.847189 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-506a0a8e-9ce4-499d-95ad-b06d0797bed6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:42.848214 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-506a0a8e-9ce4-499d-95ad-b06d0797bed6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:42.848645 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-506a0a8e-9ce4-499d-95ad-b06d0797bed6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:42.982273 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-506a0a8e-9ce4-499d-95ad-b06d0797bed6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:11:42.989994 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-506a0a8e-9ce4-499d-95ad-b06d0797bed6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1575 microversion: 2.1 time: 0.154179 Jan 05 15:11:42.990541 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 579/1156] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:11:42 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:11:44.008324 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7ab1803f-310c-4378-ba7b-735fc7dc8ad7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:11:44.009051 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7ab1803f-310c-4378-ba7b-735fc7dc8ad7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:11:44.014873 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7ab1803f-310c-4378-ba7b-735fc7dc8ad7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:44.015322 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7ab1803f-310c-4378-ba7b-735fc7dc8ad7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:44.016085 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7ab1803f-310c-4378-ba7b-735fc7dc8ad7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:44.017163 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7ab1803f-310c-4378-ba7b-735fc7dc8ad7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:44.149570 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-7ab1803f-310c-4378-ba7b-735fc7dc8ad7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:11:44.156874 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7ab1803f-310c-4378-ba7b-735fc7dc8ad7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1575 microversion: 2.1 time: 0.152806 Jan 05 15:11:44.157460 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 578/1157] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:11:44 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:11:45.174076 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c0bd8d96-6143-41e8-9a8c-93e290d2b6f2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:11:45.174686 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c0bd8d96-6143-41e8-9a8c-93e290d2b6f2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:11:45.181119 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0bd8d96-6143-41e8-9a8c-93e290d2b6f2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:45.181572 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0bd8d96-6143-41e8-9a8c-93e290d2b6f2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:45.182361 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0bd8d96-6143-41e8-9a8c-93e290d2b6f2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:45.182792 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0bd8d96-6143-41e8-9a8c-93e290d2b6f2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:45.273194 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-c0bd8d96-6143-41e8-9a8c-93e290d2b6f2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:11:45.280373 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c0bd8d96-6143-41e8-9a8c-93e290d2b6f2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1508 microversion: 2.1 time: 0.110513 Jan 05 15:11:45.280931 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 580/1158] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:11:45 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1508 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:11:45.704974 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-285a7a37-8128-4e34-b0b8-181d133ffb45 req-5c34ffea-3c41-4309-b101-9c82719c6611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f6d3cac-1745-4d46-ba6c-7342079f99b8", "name": "network-vif-deleted", "tag": "a33e7757-b68a-479b-83e9-2b37ebb10d65"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:11:45.706601 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:11:45.706601 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:11:45.714231 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-285a7a37-8128-4e34-b0b8-181d133ffb45 req-5c34ffea-3c41-4309-b101-9c82719c6611 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:45.714706 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-285a7a37-8128-4e34-b0b8-181d133ffb45 req-5c34ffea-3c41-4309-b101-9c82719c6611 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:45.727038 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-285a7a37-8128-4e34-b0b8-181d133ffb45 req-5c34ffea-3c41-4309-b101-9c82719c6611 service nova] Creating event network-vif-deleted:a33e7757-b68a-479b-83e9-2b37ebb10d65 for instance 7f6d3cac-1745-4d46-ba6c-7342079f99b8 on hv-cinder-maste Jan 05 15:11:45.732089 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-285a7a37-8128-4e34-b0b8-181d133ffb45 req-5c34ffea-3c41-4309-b101-9c82719c6611 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241220 Jan 05 15:11:45.732788 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 579/1159] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:11:46.297464 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7b3b20c1-4468-4b91-868c-7982842577f3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:11:46.298074 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7b3b20c1-4468-4b91-868c-7982842577f3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:11:46.304702 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b3b20c1-4468-4b91-868c-7982842577f3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:46.305176 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b3b20c1-4468-4b91-868c-7982842577f3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:46.305964 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b3b20c1-4468-4b91-868c-7982842577f3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:46.306585 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b3b20c1-4468-4b91-868c-7982842577f3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:46.338929 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b3b20c1-4468-4b91-868c-7982842577f3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:46.339645 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b3b20c1-4468-4b91-868c-7982842577f3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:46.340095 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-7b3b20c1-4468-4b91-868c-7982842577f3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lazy-loading 'fault' on Instance uuid 7f6d3cac-1745-4d46-ba6c-7342079f99b8 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:11:46.379895 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-7b3b20c1-4468-4b91-868c-7982842577f3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:11:46.389184 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7b3b20c1-4468-4b91-868c-7982842577f3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 200 len: 1231 microversion: 2.1 time: 0.095000 Jan 05 15:11:46.389691 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 581/1160] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:11:46 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:11:47.407507 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2870c3d5-df87-463c-8916-1673d67d8f93 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:11:47.408206 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2870c3d5-df87-463c-8916-1673d67d8f93 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:11:47.414292 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2870c3d5-df87-463c-8916-1673d67d8f93 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:47.414735 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2870c3d5-df87-463c-8916-1673d67d8f93 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:47.415505 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2870c3d5-df87-463c-8916-1673d67d8f93 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:47.415938 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2870c3d5-df87-463c-8916-1673d67d8f93 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:47.429212 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-2870c3d5-df87-463c-8916-1673d67d8f93 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] HTTP exception thrown: Instance 7f6d3cac-1745-4d46-ba6c-7342079f99b8 could not be found. Jan 05 15:11:47.429790 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2870c3d5-df87-463c-8916-1673d67d8f93 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Returning 404 to user: Instance 7f6d3cac-1745-4d46-ba6c-7342079f99b8 could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:11:47.430599 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2870c3d5-df87-463c-8916-1673d67d8f93 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 404 len: 111 microversion: 2.1 time: 0.027698 Jan 05 15:11:47.431118 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 580/1161] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:11:47 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:11:47.536505 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-899382898", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2013176654", "security_groups": [{"name": "tempest-secgroup-smoke-369949876"}], "block_device_mapping_v2": [{"uuid": "02ae9194-273c-4971-8bd9-183cef8420b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2bf0812-1bb3-4cbd-8030-193c492fed7f"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:11:47.641525 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] validate_networks() for [('b2bf0812-1bb3-4cbd-8030-193c492fed7f', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 15:11:48.339902 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 15:11:48.340353 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 15:11:48.340814 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 15:11:48.341257 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 15:11:48.341698 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 15:11:48.350383 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:48.350817 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:48.351612 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:48.352034 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:48.367711 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Getting quotas for project 4ed05f9412d9477ea62f75cd05af148b. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:11:48.371535 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Getting quotas for user 86bfbcae996a457ebe52d8c2fb7bafe4 and project 4ed05f9412d9477ea62f75cd05af148b. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:11:48.426666 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 15:11:48.430204 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='02ae9194-273c-4971-8bd9-183cef8420b0',volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 15:11:48.900966 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.368051 Jan 05 15:11:48.901922 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 582/1162] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 15:11:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 15:11:48.912323 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-3c0422bd-a660-48c1-ad66-3ca14b20e8d3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:11:48.912934 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-3c0422bd-a660-48c1-ad66-3ca14b20e8d3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:11:48.965281 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-3c0422bd-a660-48c1-ad66-3ca14b20e8d3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:11:48.972680 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-3c0422bd-a660-48c1-ad66-3ca14b20e8d3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1094 microversion: 2.1 time: 0.063905 Jan 05 15:11:48.973327 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 581/1163] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:11:48 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:11:49.990292 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f104cbb-1456-49c8-bfb4-a17ca5fb7bf1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:11:49.990880 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4f104cbb-1456-49c8-bfb4-a17ca5fb7bf1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:11:49.999029 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f104cbb-1456-49c8-bfb4-a17ca5fb7bf1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:49.999476 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f104cbb-1456-49c8-bfb4-a17ca5fb7bf1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:50.000248 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f104cbb-1456-49c8-bfb4-a17ca5fb7bf1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:50.000679 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f104cbb-1456-49c8-bfb4-a17ca5fb7bf1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:50.062745 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4f104cbb-1456-49c8-bfb4-a17ca5fb7bf1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:11:50.070437 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4f104cbb-1456-49c8-bfb4-a17ca5fb7bf1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1144 microversion: 2.1 time: 0.084272 Jan 05 15:11:50.071347 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 583/1164] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:11:49 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:11:51.091213 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-1164577a-3bec-4cbe-a6a3-f05a53f92747 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:11:51.091837 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-1164577a-3bec-4cbe-a6a3-f05a53f92747 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:11:51.099850 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1164577a-3bec-4cbe-a6a3-f05a53f92747 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:51.100303 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1164577a-3bec-4cbe-a6a3-f05a53f92747 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:51.101104 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1164577a-3bec-4cbe-a6a3-f05a53f92747 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:51.101876 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-1164577a-3bec-4cbe-a6a3-f05a53f92747 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:51.160595 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-1164577a-3bec-4cbe-a6a3-f05a53f92747 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:11:51.168027 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-1164577a-3bec-4cbe-a6a3-f05a53f92747 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1210 microversion: 2.1 time: 0.080499 Jan 05 15:11:51.168780 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 582/1165] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:11:51 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1210 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:11:52.185610 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-33b3ada3-812c-489c-b780-0865010967d6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:11:52.186217 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-33b3ada3-812c-489c-b780-0865010967d6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:11:52.193845 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33b3ada3-812c-489c-b780-0865010967d6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:52.194291 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33b3ada3-812c-489c-b780-0865010967d6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:52.195086 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33b3ada3-812c-489c-b780-0865010967d6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:52.195516 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33b3ada3-812c-489c-b780-0865010967d6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:52.378668 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-33b3ada3-812c-489c-b780-0865010967d6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:11:52.386851 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-33b3ada3-812c-489c-b780-0865010967d6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1277 microversion: 2.1 time: 0.205439 Jan 05 15:11:52.395947 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 584/1166] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:11:52 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:11:52.641387 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-dee439dd-0db3-4bd9-8c90-b9cfcb303c52 req-4e69d6ba-3f80-4b1e-8a40-974c2d56f35a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7fa3a7a-27e0-4b5d-a172-1af7d87cde71", "tag": "5fd3adff-46db-4f6c-976b-1c61edeb54cb"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:11:52.643314 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:11:52.643314 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:11:52.651706 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-dee439dd-0db3-4bd9-8c90-b9cfcb303c52 req-4e69d6ba-3f80-4b1e-8a40-974c2d56f35a service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:52.652172 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-dee439dd-0db3-4bd9-8c90-b9cfcb303c52 req-4e69d6ba-3f80-4b1e-8a40-974c2d56f35a service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:52.667049 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-dee439dd-0db3-4bd9-8c90-b9cfcb303c52 req-4e69d6ba-3f80-4b1e-8a40-974c2d56f35a service nova] Creating event network-changed:5fd3adff-46db-4f6c-976b-1c61edeb54cb for instance f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 on hv-cinder-maste Jan 05 15:11:52.672189 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-dee439dd-0db3-4bd9-8c90-b9cfcb303c52 req-4e69d6ba-3f80-4b1e-8a40-974c2d56f35a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034884 Jan 05 15:11:52.672792 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 583/1167] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:11:53.415961 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-314fdafc-c2f4-49f0-bec6-443cf451783e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:11:53.415961 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-314fdafc-c2f4-49f0-bec6-443cf451783e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:11:53.418093 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-314fdafc-c2f4-49f0-bec6-443cf451783e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:53.418534 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-314fdafc-c2f4-49f0-bec6-443cf451783e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:53.419296 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-314fdafc-c2f4-49f0-bec6-443cf451783e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:53.419777 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-314fdafc-c2f4-49f0-bec6-443cf451783e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:53.555428 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-314fdafc-c2f4-49f0-bec6-443cf451783e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:11:53.562688 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-314fdafc-c2f4-49f0-bec6-443cf451783e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1265 microversion: 2.1 time: 0.155128 Jan 05 15:11:53.567647 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 585/1168] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:11:53 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:11:54.581197 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f72df2d8-e029-4b97-8ee8-d604c3d702ec tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:11:54.581902 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f72df2d8-e029-4b97-8ee8-d604c3d702ec tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:11:54.588331 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f72df2d8-e029-4b97-8ee8-d604c3d702ec tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:54.588782 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f72df2d8-e029-4b97-8ee8-d604c3d702ec tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:54.589595 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f72df2d8-e029-4b97-8ee8-d604c3d702ec tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:54.590080 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f72df2d8-e029-4b97-8ee8-d604c3d702ec tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:54.721876 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f72df2d8-e029-4b97-8ee8-d604c3d702ec tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:11:54.729347 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f72df2d8-e029-4b97-8ee8-d604c3d702ec tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1265 microversion: 2.1 time: 0.152874 Jan 05 15:11:54.729910 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 584/1169] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:11:54 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:11:55.745605 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4efabc98-10ea-46ff-ae8e-758585e6213f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:11:55.746205 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4efabc98-10ea-46ff-ae8e-758585e6213f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:11:55.752961 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4efabc98-10ea-46ff-ae8e-758585e6213f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:55.753420 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4efabc98-10ea-46ff-ae8e-758585e6213f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:55.754180 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4efabc98-10ea-46ff-ae8e-758585e6213f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:55.754603 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4efabc98-10ea-46ff-ae8e-758585e6213f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:55.882675 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-4efabc98-10ea-46ff-ae8e-758585e6213f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:11:55.889862 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4efabc98-10ea-46ff-ae8e-758585e6213f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1265 microversion: 2.1 time: 0.147903 Jan 05 15:11:55.890425 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 586/1170] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:11:55 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:11:56.906419 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-8f770c72-bead-446c-b405-677f21d10961 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:11:56.907083 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-8f770c72-bead-446c-b405-677f21d10961 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:11:56.913230 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8f770c72-bead-446c-b405-677f21d10961 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:56.913672 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8f770c72-bead-446c-b405-677f21d10961 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:56.914432 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8f770c72-bead-446c-b405-677f21d10961 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:56.914860 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8f770c72-bead-446c-b405-677f21d10961 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:57.045874 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-8f770c72-bead-446c-b405-677f21d10961 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:11:57.053713 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-8f770c72-bead-446c-b405-677f21d10961 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1265 microversion: 2.1 time: 0.151062 Jan 05 15:11:57.054278 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 585/1171] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:11:56 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:11:58.070336 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b6d805a8-bc9a-446f-ab25-984dde1389df tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:11:58.077134 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b6d805a8-bc9a-446f-ab25-984dde1389df tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:11:58.077300 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6d805a8-bc9a-446f-ab25-984dde1389df tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:58.077632 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6d805a8-bc9a-446f-ab25-984dde1389df tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:58.078402 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6d805a8-bc9a-446f-ab25-984dde1389df tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:58.078836 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6d805a8-bc9a-446f-ab25-984dde1389df tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:58.207913 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b6d805a8-bc9a-446f-ab25-984dde1389df tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:11:58.215200 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b6d805a8-bc9a-446f-ab25-984dde1389df tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1265 microversion: 2.1 time: 0.148511 Jan 05 15:11:58.215753 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 587/1172] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:11:58 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:11:59.232473 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-8d971cbe-7daf-4267-9ba0-ea470db8186c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:11:59.233101 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-8d971cbe-7daf-4267-9ba0-ea470db8186c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:11:59.239767 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8d971cbe-7daf-4267-9ba0-ea470db8186c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:59.240207 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8d971cbe-7daf-4267-9ba0-ea470db8186c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:59.240974 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8d971cbe-7daf-4267-9ba0-ea470db8186c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:11:59.241427 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-8d971cbe-7daf-4267-9ba0-ea470db8186c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:11:59.368642 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-8d971cbe-7daf-4267-9ba0-ea470db8186c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:11:59.375795 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-8d971cbe-7daf-4267-9ba0-ea470db8186c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1265 microversion: 2.1 time: 0.147515 Jan 05 15:11:59.376911 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 586/1173] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:11:59 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:12:00.392701 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-633f9025-110e-4e4e-8475-a14cfa93aa30 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:12:00.393647 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-633f9025-110e-4e4e-8475-a14cfa93aa30 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:12:00.399590 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-633f9025-110e-4e4e-8475-a14cfa93aa30 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:00.400040 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-633f9025-110e-4e4e-8475-a14cfa93aa30 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:00.400815 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-633f9025-110e-4e4e-8475-a14cfa93aa30 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:00.401290 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-633f9025-110e-4e4e-8475-a14cfa93aa30 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:00.534702 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-633f9025-110e-4e4e-8475-a14cfa93aa30 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:12:00.542017 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-633f9025-110e-4e4e-8475-a14cfa93aa30 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1265 microversion: 2.1 time: 0.153027 Jan 05 15:12:00.542584 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 588/1174] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:12:00 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:12:01.558921 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-9245e781-47b7-4e98-a989-f37200e57b6a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:12:01.559596 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-9245e781-47b7-4e98-a989-f37200e57b6a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:12:01.566014 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9245e781-47b7-4e98-a989-f37200e57b6a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:01.566455 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9245e781-47b7-4e98-a989-f37200e57b6a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:01.567217 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9245e781-47b7-4e98-a989-f37200e57b6a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:01.567642 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9245e781-47b7-4e98-a989-f37200e57b6a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:01.696800 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-9245e781-47b7-4e98-a989-f37200e57b6a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:12:01.704118 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-9245e781-47b7-4e98-a989-f37200e57b6a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1265 microversion: 2.1 time: 0.148822 Jan 05 15:12:01.704691 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 587/1175] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:12:01 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:12:02.720595 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7b52043d-e08c-41ff-bfa5-7270ba0f63c2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:12:02.721884 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7b52043d-e08c-41ff-bfa5-7270ba0f63c2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:12:02.728656 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b52043d-e08c-41ff-bfa5-7270ba0f63c2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:02.729130 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b52043d-e08c-41ff-bfa5-7270ba0f63c2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:02.729910 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b52043d-e08c-41ff-bfa5-7270ba0f63c2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:02.730346 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b52043d-e08c-41ff-bfa5-7270ba0f63c2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:02.864267 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-7b52043d-e08c-41ff-bfa5-7270ba0f63c2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:12:02.871814 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7b52043d-e08c-41ff-bfa5-7270ba0f63c2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1265 microversion: 2.1 time: 0.154854 Jan 05 15:12:02.872387 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 589/1176] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:12:02 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:12:03.888854 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-f73838a8-10bf-4a25-a614-8d9267d156a5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:12:03.889532 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-f73838a8-10bf-4a25-a614-8d9267d156a5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:12:03.895808 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f73838a8-10bf-4a25-a614-8d9267d156a5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:03.896256 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f73838a8-10bf-4a25-a614-8d9267d156a5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:03.897024 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f73838a8-10bf-4a25-a614-8d9267d156a5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:03.897482 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-f73838a8-10bf-4a25-a614-8d9267d156a5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:04.027145 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-f73838a8-10bf-4a25-a614-8d9267d156a5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:12:04.035067 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-f73838a8-10bf-4a25-a614-8d9267d156a5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1265 microversion: 2.1 time: 0.149885 Jan 05 15:12:04.035633 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 588/1177] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:12:03 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:12:05.051666 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-11cacaf9-597f-45cd-930b-121f340ece87 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:12:05.052364 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-11cacaf9-597f-45cd-930b-121f340ece87 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:12:05.058852 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11cacaf9-597f-45cd-930b-121f340ece87 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:05.059621 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11cacaf9-597f-45cd-930b-121f340ece87 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:05.060080 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11cacaf9-597f-45cd-930b-121f340ece87 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:05.060515 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11cacaf9-597f-45cd-930b-121f340ece87 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:05.188856 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-3152ad7f-0443-4196-b248-9fa3c23d4a63 req-e884aa46-7fc0-42ce-a447-8b6b4322e416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7fa3a7a-27e0-4b5d-a172-1af7d87cde71", "name": "network-vif-plugged", "status": "completed", "tag": "5fd3adff-46db-4f6c-976b-1c61edeb54cb"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:12:05.191190 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:12:05.191190 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:12:05.198177 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-3152ad7f-0443-4196-b248-9fa3c23d4a63 req-e884aa46-7fc0-42ce-a447-8b6b4322e416 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:05.202917 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-3152ad7f-0443-4196-b248-9fa3c23d4a63 req-e884aa46-7fc0-42ce-a447-8b6b4322e416 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:05.206624 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-11cacaf9-597f-45cd-930b-121f340ece87 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:12:05.209953 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-3152ad7f-0443-4196-b248-9fa3c23d4a63 req-e884aa46-7fc0-42ce-a447-8b6b4322e416 service nova] Creating event network-vif-plugged:5fd3adff-46db-4f6c-976b-1c61edeb54cb for instance f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 on hv-cinder-maste Jan 05 15:12:05.214216 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-11cacaf9-597f-45cd-930b-121f340ece87 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1265 microversion: 2.1 time: 0.166315 Jan 05 15:12:05.214782 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 590/1178] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:12:05 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:12:05.214997 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-3152ad7f-0443-4196-b248-9fa3c23d4a63 req-e884aa46-7fc0-42ce-a447-8b6b4322e416 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084534 Jan 05 15:12:05.215631 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 589/1179] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:12:06.231724 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9943c17a-8c7c-434c-a8d4-6a47da88ef0e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:12:06.232329 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9943c17a-8c7c-434c-a8d4-6a47da88ef0e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:12:06.239467 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9943c17a-8c7c-434c-a8d4-6a47da88ef0e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:06.239918 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9943c17a-8c7c-434c-a8d4-6a47da88ef0e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:06.240702 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9943c17a-8c7c-434c-a8d4-6a47da88ef0e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:06.241160 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9943c17a-8c7c-434c-a8d4-6a47da88ef0e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:06.370912 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-9943c17a-8c7c-434c-a8d4-6a47da88ef0e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:12:06.378149 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9943c17a-8c7c-434c-a8d4-6a47da88ef0e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1265 microversion: 2.1 time: 0.150076 Jan 05 15:12:06.378723 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 591/1180] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:12:06 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:12:07.395563 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7d8557ef-e5a9-4293-ac5e-4da6f61395b1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:12:07.396259 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7d8557ef-e5a9-4293-ac5e-4da6f61395b1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:12:07.402314 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7d8557ef-e5a9-4293-ac5e-4da6f61395b1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:07.402755 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7d8557ef-e5a9-4293-ac5e-4da6f61395b1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:07.403549 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7d8557ef-e5a9-4293-ac5e-4da6f61395b1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:07.403980 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7d8557ef-e5a9-4293-ac5e-4da6f61395b1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:07.537407 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-7d8557ef-e5a9-4293-ac5e-4da6f61395b1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:12:07.544673 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7d8557ef-e5a9-4293-ac5e-4da6f61395b1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1450 microversion: 2.1 time: 0.153608 Jan 05 15:12:07.545263 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 590/1181] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:12:07 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:12:07.560538 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-670cc92e-541d-485f-aab6-cc8ab880ed29 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:12:07.561190 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-670cc92e-541d-485f-aab6-cc8ab880ed29 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:12:07.567310 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-670cc92e-541d-485f-aab6-cc8ab880ed29 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:07.567755 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-670cc92e-541d-485f-aab6-cc8ab880ed29 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:07.568519 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-670cc92e-541d-485f-aab6-cc8ab880ed29 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:07.568946 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-670cc92e-541d-485f-aab6-cc8ab880ed29 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:07.699721 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-670cc92e-541d-485f-aab6-cc8ab880ed29 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:12:07.703179 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-670cc92e-541d-485f-aab6-cc8ab880ed29 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1450 microversion: 2.1 time: 0.146277 Jan 05 15:12:07.703741 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 592/1182] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:12:07 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1450 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:12:09.617784 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-c37da17b-05f5-4212-ba62-0a904d636db7 req-11571917-3075-4a88-b83b-77e58b0e109b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7fa3a7a-27e0-4b5d-a172-1af7d87cde71", "tag": "5fd3adff-46db-4f6c-976b-1c61edeb54cb"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:12:09.619344 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:12:09.619344 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:12:09.626227 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-c37da17b-05f5-4212-ba62-0a904d636db7 req-11571917-3075-4a88-b83b-77e58b0e109b service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:12:09.626664 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-c37da17b-05f5-4212-ba62-0a904d636db7 req-11571917-3075-4a88-b83b-77e58b0e109b service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:12:09.637547 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-c37da17b-05f5-4212-ba62-0a904d636db7 req-11571917-3075-4a88-b83b-77e58b0e109b service nova] Creating event network-changed:5fd3adff-46db-4f6c-976b-1c61edeb54cb for instance f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 on hv-cinder-maste Jan 05 15:12:09.642787 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-c37da17b-05f5-4212-ba62-0a904d636db7 req-11571917-3075-4a88-b83b-77e58b0e109b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082944 Jan 05 15:12:09.644141 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 591/1183] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:12:15.568182 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 15:12:15.568667 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: Wed Jan 5 15:12:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 15:13:43.861157 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1295449836", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2013176654", "security_groups": [{"name": "tempest-secgroup-smoke-369949876"}], "block_device_mapping_v2": [{"uuid": "4a2fb26e-ace2-43df-b18e-07e9bc117a69", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2bf0812-1bb3-4cbd-8030-193c492fed7f"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:13:43.966920 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] validate_networks() for [('b2bf0812-1bb3-4cbd-8030-193c492fed7f', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 05 15:13:44.317673 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 15:13:44.318066 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 15:13:44.318557 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 15:13:44.318959 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 15:13:44.319359 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 15:13:44.327690 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:44.328126 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:44.328918 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:44.329379 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:44.344973 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Getting quotas for project 4ed05f9412d9477ea62f75cd05af148b. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 15:13:44.348864 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.quota [None req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Getting quotas for user 86bfbcae996a457ebe52d8c2fb7bafe4 and project 4ed05f9412d9477ea62f75cd05af148b. Resources: {'instances', 'cores', 'ram'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 15:13:44.402138 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 15:13:44.404218 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a2fb26e-ace2-43df-b18e-07e9bc117a69',volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 15:13:44.771694 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.915170 Jan 05 15:13:44.772331 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 593/1184] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Jan 5 15:13:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 15:13:44.784070 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-bf1f7739-feea-4e15-ac2b-58bd9c5527ac tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:13:44.784820 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-bf1f7739-feea-4e15-ac2b-58bd9c5527ac tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:13:44.837246 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-bf1f7739-feea-4e15-ac2b-58bd9c5527ac tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:13:44.844208 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-bf1f7739-feea-4e15-ac2b-58bd9c5527ac tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1095 microversion: 2.1 time: 0.065817 Jan 05 15:13:44.844775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 592/1185] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:13:44 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:13:45.877910 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-68add5de-bb27-42de-bcb8-b0f3943b03ae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:13:45.877910 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-68add5de-bb27-42de-bcb8-b0f3943b03ae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:13:45.911884 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-68add5de-bb27-42de-bcb8-b0f3943b03ae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:13:45.918307 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-68add5de-bb27-42de-bcb8-b0f3943b03ae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1095 microversion: 2.1 time: 0.061053 Jan 05 15:13:45.918870 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 594/1186] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:13:45 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1095 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:13:46.934692 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-77bd514b-bae9-49d3-ae3c-e95104b2274b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:13:46.935301 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-77bd514b-bae9-49d3-ae3c-e95104b2274b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:13:46.992276 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-77bd514b-bae9-49d3-ae3c-e95104b2274b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:13:46.999244 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-77bd514b-bae9-49d3-ae3c-e95104b2274b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1095 microversion: 2.1 time: 0.068161 Jan 05 15:13:46.999794 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 593/1187] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:13:46 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:13:48.015216 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c9000383-6565-4774-b04b-2d447fd9bc09 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:13:48.015833 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c9000383-6565-4774-b04b-2d447fd9bc09 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:13:48.077316 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-c9000383-6565-4774-b04b-2d447fd9bc09 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:13:48.084253 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c9000383-6565-4774-b04b-2d447fd9bc09 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1095 microversion: 2.1 time: 0.072731 Jan 05 15:13:48.084822 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 595/1188] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:13:48 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:13:49.099875 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-4c6106e6-e55b-4b72-8cc3-fc55032176d1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:13:49.100431 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-4c6106e6-e55b-4b72-8cc3-fc55032176d1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:13:49.106971 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4c6106e6-e55b-4b72-8cc3-fc55032176d1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:49.108007 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4c6106e6-e55b-4b72-8cc3-fc55032176d1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:49.108787 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4c6106e6-e55b-4b72-8cc3-fc55032176d1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:49.109250 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4c6106e6-e55b-4b72-8cc3-fc55032176d1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:49.165191 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-4c6106e6-e55b-4b72-8cc3-fc55032176d1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:13:49.172920 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-4c6106e6-e55b-4b72-8cc3-fc55032176d1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1145 microversion: 2.1 time: 0.076849 Jan 05 15:13:49.173511 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 594/1189] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:13:49 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1145 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:13:50.189360 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-58570900-b6ee-403f-9b50-81b55f963377 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:13:50.189974 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-58570900-b6ee-403f-9b50-81b55f963377 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:13:50.196124 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58570900-b6ee-403f-9b50-81b55f963377 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:50.196571 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58570900-b6ee-403f-9b50-81b55f963377 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:50.197383 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58570900-b6ee-403f-9b50-81b55f963377 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:50.197817 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58570900-b6ee-403f-9b50-81b55f963377 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:50.256001 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-58570900-b6ee-403f-9b50-81b55f963377 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:13:50.263151 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-58570900-b6ee-403f-9b50-81b55f963377 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1193 microversion: 2.1 time: 0.077501 Jan 05 15:13:50.264444 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 596/1190] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:13:50 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1193 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:13:51.280311 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-bba6dbe6-0e17-45bd-9105-3c5f0a77fb52 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:13:51.280941 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-bba6dbe6-0e17-45bd-9105-3c5f0a77fb52 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:13:51.287320 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bba6dbe6-0e17-45bd-9105-3c5f0a77fb52 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:51.287775 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bba6dbe6-0e17-45bd-9105-3c5f0a77fb52 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:51.288568 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bba6dbe6-0e17-45bd-9105-3c5f0a77fb52 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:51.289033 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-bba6dbe6-0e17-45bd-9105-3c5f0a77fb52 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:51.349707 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-bba6dbe6-0e17-45bd-9105-3c5f0a77fb52 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:13:51.356966 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-bba6dbe6-0e17-45bd-9105-3c5f0a77fb52 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1211 microversion: 2.1 time: 0.080972 Jan 05 15:13:51.358162 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 595/1191] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:13:51 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:13:52.375989 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ae5a795a-dfb2-45e3-91ca-31d60d6b0f48 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:13:52.376538 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ae5a795a-dfb2-45e3-91ca-31d60d6b0f48 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:13:52.383878 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae5a795a-dfb2-45e3-91ca-31d60d6b0f48 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:52.384580 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae5a795a-dfb2-45e3-91ca-31d60d6b0f48 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:52.386334 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae5a795a-dfb2-45e3-91ca-31d60d6b0f48 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:52.386616 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae5a795a-dfb2-45e3-91ca-31d60d6b0f48 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:52.405423 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-e72fa5d5-25bd-4004-acbb-cffaf693ea3c req-e56cfb8b-40e8-4c44-a147-544b2ddbc077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c", "tag": "113c50f8-3fe6-4232-9abc-c3a1f377fc13"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:13:52.408155 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:13:52.408155 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:13:52.417248 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-e72fa5d5-25bd-4004-acbb-cffaf693ea3c req-e56cfb8b-40e8-4c44-a147-544b2ddbc077 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:52.424059 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-e72fa5d5-25bd-4004-acbb-cffaf693ea3c req-e56cfb8b-40e8-4c44-a147-544b2ddbc077 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:52.442115 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-e72fa5d5-25bd-4004-acbb-cffaf693ea3c req-e56cfb8b-40e8-4c44-a147-544b2ddbc077 service nova] Creating event network-changed:113c50f8-3fe6-4232-9abc-c3a1f377fc13 for instance a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c on hv-cinder-maste Jan 05 15:13:52.447576 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-e72fa5d5-25bd-4004-acbb-cffaf693ea3c req-e56cfb8b-40e8-4c44-a147-544b2ddbc077 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049154 Jan 05 15:13:52.448314 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 596/1192] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:13:52.871670 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-ae5a795a-dfb2-45e3-91ca-31d60d6b0f48 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:13:52.879558 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ae5a795a-dfb2-45e3-91ca-31d60d6b0f48 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1266 microversion: 2.1 time: 0.507619 Jan 05 15:13:52.880252 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 597/1193] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:13:52 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1266 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:13:53.897436 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2b9e7575-0baf-48f7-8d5c-75bdbb129c7f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:13:53.898127 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2b9e7575-0baf-48f7-8d5c-75bdbb129c7f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:13:53.904546 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2b9e7575-0baf-48f7-8d5c-75bdbb129c7f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:53.904987 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2b9e7575-0baf-48f7-8d5c-75bdbb129c7f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:53.905804 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2b9e7575-0baf-48f7-8d5c-75bdbb129c7f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:53.906238 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2b9e7575-0baf-48f7-8d5c-75bdbb129c7f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:54.032812 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-2b9e7575-0baf-48f7-8d5c-75bdbb129c7f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:13:54.040083 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2b9e7575-0baf-48f7-8d5c-75bdbb129c7f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1266 microversion: 2.1 time: 0.146765 Jan 05 15:13:54.040636 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 597/1194] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:13:53 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:13:55.056803 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-00e6146b-2f50-4cfc-b6b6-083d145d85bc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:13:55.057423 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-00e6146b-2f50-4cfc-b6b6-083d145d85bc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:13:55.064076 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00e6146b-2f50-4cfc-b6b6-083d145d85bc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:55.064519 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00e6146b-2f50-4cfc-b6b6-083d145d85bc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:55.065339 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00e6146b-2f50-4cfc-b6b6-083d145d85bc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:55.065766 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00e6146b-2f50-4cfc-b6b6-083d145d85bc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:55.196705 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-00e6146b-2f50-4cfc-b6b6-083d145d85bc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:13:55.204772 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-00e6146b-2f50-4cfc-b6b6-083d145d85bc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1266 microversion: 2.1 time: 0.151571 Jan 05 15:13:55.205367 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 598/1195] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:13:55 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:13:56.221392 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-befaaaa7-0e0d-4612-bc72-1837bebd5356 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:13:56.221995 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-befaaaa7-0e0d-4612-bc72-1837bebd5356 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:13:56.228185 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-befaaaa7-0e0d-4612-bc72-1837bebd5356 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:56.228627 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-befaaaa7-0e0d-4612-bc72-1837bebd5356 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:56.229423 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-befaaaa7-0e0d-4612-bc72-1837bebd5356 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:56.229852 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-befaaaa7-0e0d-4612-bc72-1837bebd5356 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:56.359250 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-befaaaa7-0e0d-4612-bc72-1837bebd5356 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:13:56.366411 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-befaaaa7-0e0d-4612-bc72-1837bebd5356 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1266 microversion: 2.1 time: 0.149037 Jan 05 15:13:56.366968 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 598/1196] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:13:56 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:13:57.383304 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b9e87983-0ea2-4f62-8ff7-4aefb838b1e3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:13:57.383970 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b9e87983-0ea2-4f62-8ff7-4aefb838b1e3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:13:57.390857 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9e87983-0ea2-4f62-8ff7-4aefb838b1e3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:57.391303 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9e87983-0ea2-4f62-8ff7-4aefb838b1e3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:57.392080 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9e87983-0ea2-4f62-8ff7-4aefb838b1e3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:57.392511 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9e87983-0ea2-4f62-8ff7-4aefb838b1e3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:57.520104 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-b9e87983-0ea2-4f62-8ff7-4aefb838b1e3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:13:57.527468 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b9e87983-0ea2-4f62-8ff7-4aefb838b1e3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1266 microversion: 2.1 time: 0.147830 Jan 05 15:13:57.528022 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 599/1197] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:13:57 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:13:58.543608 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7572a341-12e8-4495-aaa4-dd8eb3be8655 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:13:58.544213 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7572a341-12e8-4495-aaa4-dd8eb3be8655 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:13:58.550506 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7572a341-12e8-4495-aaa4-dd8eb3be8655 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:58.550949 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7572a341-12e8-4495-aaa4-dd8eb3be8655 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:58.551711 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7572a341-12e8-4495-aaa4-dd8eb3be8655 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:58.552145 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7572a341-12e8-4495-aaa4-dd8eb3be8655 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:58.678739 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-7572a341-12e8-4495-aaa4-dd8eb3be8655 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:13:58.686106 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7572a341-12e8-4495-aaa4-dd8eb3be8655 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1266 microversion: 2.1 time: 0.146197 Jan 05 15:13:58.686669 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 599/1198] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:13:58 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:13:59.782625 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ff3c3add-5013-4ba5-a299-198abd12df51 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:13:59.783244 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ff3c3add-5013-4ba5-a299-198abd12df51 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:13:59.788933 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff3c3add-5013-4ba5-a299-198abd12df51 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:59.789416 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff3c3add-5013-4ba5-a299-198abd12df51 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:59.790186 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff3c3add-5013-4ba5-a299-198abd12df51 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:13:59.790617 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff3c3add-5013-4ba5-a299-198abd12df51 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:13:59.921792 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-ff3c3add-5013-4ba5-a299-198abd12df51 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:13:59.928883 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ff3c3add-5013-4ba5-a299-198abd12df51 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1266 microversion: 2.1 time: 0.230012 Jan 05 15:13:59.929474 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 600/1199] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:13:59 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:14:00.946225 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-19827b39-9b83-4288-b392-be80e17d2943 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:14:00.947660 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-19827b39-9b83-4288-b392-be80e17d2943 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:14:00.954475 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-19827b39-9b83-4288-b392-be80e17d2943 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:14:00.954916 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-19827b39-9b83-4288-b392-be80e17d2943 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:14:00.956050 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-19827b39-9b83-4288-b392-be80e17d2943 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:14:00.956480 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-19827b39-9b83-4288-b392-be80e17d2943 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:14:01.087275 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-19827b39-9b83-4288-b392-be80e17d2943 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:14:01.094525 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-19827b39-9b83-4288-b392-be80e17d2943 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1266 microversion: 2.1 time: 0.152519 Jan 05 15:14:01.095349 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 600/1200] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:14:00 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:14:02.111883 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e1463d70-a7ef-4d21-85ee-cbf366137133 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:14:02.112459 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e1463d70-a7ef-4d21-85ee-cbf366137133 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:14:02.118681 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1463d70-a7ef-4d21-85ee-cbf366137133 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:14:02.119129 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1463d70-a7ef-4d21-85ee-cbf366137133 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:14:02.119950 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1463d70-a7ef-4d21-85ee-cbf366137133 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:14:02.120387 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1463d70-a7ef-4d21-85ee-cbf366137133 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:14:02.248441 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-e1463d70-a7ef-4d21-85ee-cbf366137133 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:14:02.255749 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e1463d70-a7ef-4d21-85ee-cbf366137133 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1266 microversion: 2.1 time: 0.148280 Jan 05 15:14:02.256310 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 601/1201] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:14:02 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:14:03.272493 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-4b2b22be-460b-4967-8509-19de6325a168 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:14:03.273200 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-4b2b22be-460b-4967-8509-19de6325a168 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:14:03.279498 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4b2b22be-460b-4967-8509-19de6325a168 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:14:03.279951 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4b2b22be-460b-4967-8509-19de6325a168 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:14:03.281341 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4b2b22be-460b-4967-8509-19de6325a168 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:14:03.281791 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-4b2b22be-460b-4967-8509-19de6325a168 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:14:03.410171 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-4b2b22be-460b-4967-8509-19de6325a168 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:14:03.415852 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-4b2b22be-460b-4967-8509-19de6325a168 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1266 microversion: 2.1 time: 0.147043 Jan 05 15:14:03.416420 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 601/1202] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:14:03 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:14:03.890291 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e4ca78eb-9118-405e-b6c0-63dbc6d495fd req-44f18818-5aa4-4572-8ab0-0ca25ecf7928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c", "name": "network-vif-plugged", "status": "completed", "tag": "113c50f8-3fe6-4232-9abc-c3a1f377fc13"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:14:03.892190 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:14:03.892190 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:14:03.899193 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e4ca78eb-9118-405e-b6c0-63dbc6d495fd req-44f18818-5aa4-4572-8ab0-0ca25ecf7928 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:14:03.899652 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e4ca78eb-9118-405e-b6c0-63dbc6d495fd req-44f18818-5aa4-4572-8ab0-0ca25ecf7928 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:14:03.910627 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e4ca78eb-9118-405e-b6c0-63dbc6d495fd req-44f18818-5aa4-4572-8ab0-0ca25ecf7928 service nova] Creating event network-vif-plugged:113c50f8-3fe6-4232-9abc-c3a1f377fc13 for instance a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c on hv-cinder-maste Jan 05 15:14:03.914007 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: ERROR oslo.messaging._drivers.impl_rabbit [req-e4ca78eb-9118-405e-b6c0-63dbc6d495fd req-44f18818-5aa4-4572-8ab0-0ca25ecf7928 service nova] [d12dc676-65ea-4aa3-b130-1e69d07d8563] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 05 15:14:04.432881 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-c52ebca3-57d1-408b-9d4e-e8e0969db355 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:14:04.433522 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-c52ebca3-57d1-408b-9d4e-e8e0969db355 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:14:04.440307 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c52ebca3-57d1-408b-9d4e-e8e0969db355 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:14:04.440765 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c52ebca3-57d1-408b-9d4e-e8e0969db355 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:14:04.441587 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c52ebca3-57d1-408b-9d4e-e8e0969db355 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:14:04.442023 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-c52ebca3-57d1-408b-9d4e-e8e0969db355 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:14:04.572929 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-c52ebca3-57d1-408b-9d4e-e8e0969db355 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:14:04.580280 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-c52ebca3-57d1-408b-9d4e-e8e0969db355 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1266 microversion: 2.1 time: 0.151196 Jan 05 15:14:04.580869 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 602/1203] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:14:04 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 15:14:04.921577 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [req-e4ca78eb-9118-405e-b6c0-63dbc6d495fd req-44f18818-5aa4-4572-8ab0-0ca25ecf7928 service nova] [d12dc676-65ea-4aa3-b130-1e69d07d8563] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 41790. Jan 05 15:14:04.924879 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e4ca78eb-9118-405e-b6c0-63dbc6d495fd req-44f18818-5aa4-4572-8ab0-0ca25ecf7928 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.038820 Jan 05 15:14:04.925517 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 602/1204] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:14:05.597029 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-9659f4b0-85b0-4144-be56-5d6d12d958f8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:14:05.597658 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-9659f4b0-85b0-4144-be56-5d6d12d958f8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:14:05.603884 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9659f4b0-85b0-4144-be56-5d6d12d958f8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:14:05.604326 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9659f4b0-85b0-4144-be56-5d6d12d958f8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:14:05.605156 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9659f4b0-85b0-4144-be56-5d6d12d958f8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:14:05.605607 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-9659f4b0-85b0-4144-be56-5d6d12d958f8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:14:05.739170 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-9659f4b0-85b0-4144-be56-5d6d12d958f8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:14:05.746421 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-9659f4b0-85b0-4144-be56-5d6d12d958f8 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1266 microversion: 2.1 time: 0.153494 Jan 05 15:14:05.746985 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 603/1205] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:14:05 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:14:06.764027 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cafe6629-c1cc-44c5-8600-2c7bc7ec200a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:14:06.764733 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cafe6629-c1cc-44c5-8600-2c7bc7ec200a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:14:06.771482 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cafe6629-c1cc-44c5-8600-2c7bc7ec200a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:14:06.771932 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cafe6629-c1cc-44c5-8600-2c7bc7ec200a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:14:06.772708 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cafe6629-c1cc-44c5-8600-2c7bc7ec200a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:14:06.773174 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cafe6629-c1cc-44c5-8600-2c7bc7ec200a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:14:06.905188 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-cafe6629-c1cc-44c5-8600-2c7bc7ec200a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:14:06.913046 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cafe6629-c1cc-44c5-8600-2c7bc7ec200a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1451 microversion: 2.1 time: 0.153482 Jan 05 15:14:06.913643 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 603/1206] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:14:06 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:14:06.928415 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-e920273f-8e81-4eab-a962-d7a1cad37669 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:14:06.929059 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-e920273f-8e81-4eab-a962-d7a1cad37669 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:14:06.935246 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e920273f-8e81-4eab-a962-d7a1cad37669 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:14:06.935717 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e920273f-8e81-4eab-a962-d7a1cad37669 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:14:06.936488 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e920273f-8e81-4eab-a962-d7a1cad37669 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:14:06.936923 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-e920273f-8e81-4eab-a962-d7a1cad37669 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:14:07.066497 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-e920273f-8e81-4eab-a962-d7a1cad37669 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:14:07.073834 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-e920273f-8e81-4eab-a962-d7a1cad37669 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1451 microversion: 2.1 time: 0.149081 Jan 05 15:14:07.074401 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 604/1207] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:14:06 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:14:09.202506 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-2fcfebcb-2ae6-40d7-8c4f-53823314bf8c req-e4fa6fe8-c784-42cf-8131-bafe42913fdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c", "tag": "113c50f8-3fe6-4232-9abc-c3a1f377fc13"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:14:09.204388 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:14:09.204388 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:14:09.211673 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2fcfebcb-2ae6-40d7-8c4f-53823314bf8c req-e4fa6fe8-c784-42cf-8131-bafe42913fdf service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:14:09.212115 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2fcfebcb-2ae6-40d7-8c4f-53823314bf8c req-e4fa6fe8-c784-42cf-8131-bafe42913fdf service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:14:09.223459 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-2fcfebcb-2ae6-40d7-8c4f-53823314bf8c req-e4fa6fe8-c784-42cf-8131-bafe42913fdf service nova] Creating event network-changed:113c50f8-3fe6-4232-9abc-c3a1f377fc13 for instance a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c on hv-cinder-maste Jan 05 15:14:09.228251 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-2fcfebcb-2ae6-40d7-8c4f-53823314bf8c req-e4fa6fe8-c784-42cf-8131-bafe42913fdf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029490 Jan 05 15:14:09.228835 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 604/1208] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:14:27.678260 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 15:14:27.678771 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: Wed Jan 5 15:14:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 15:14:36.624938 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 15:14:36.625526 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: Wed Jan 5 15:14:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 15:15:35.577652 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 15:15:35.578702 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: Wed Jan 5 15:15:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 15:15:40.567937 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:15:40.569105 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:15:40.574505 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-998198ae-e0cb-44e4-b0a3-ab2385b008e1 req-1ba8d711-7863-4eee-a102-90bc23b3e4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c", "tag": "113c50f8-3fe6-4232-9abc-c3a1f377fc13"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:15:40.576106 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:15:40.576106 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:15:40.577544 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:40.578004 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:40.578816 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:40.579259 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:40.584665 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-998198ae-e0cb-44e4-b0a3-ab2385b008e1 req-1ba8d711-7863-4eee-a102-90bc23b3e4d5 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:40.585312 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-998198ae-e0cb-44e4-b0a3-ab2385b008e1 req-1ba8d711-7863-4eee-a102-90bc23b3e4d5 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:40.599347 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-998198ae-e0cb-44e4-b0a3-ab2385b008e1 req-1ba8d711-7863-4eee-a102-90bc23b3e4d5 service nova] Creating event network-changed:113c50f8-3fe6-4232-9abc-c3a1f377fc13 for instance a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c on hv-cinder-maste Jan 05 15:15:40.605187 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-998198ae-e0cb-44e4-b0a3-ab2385b008e1 req-1ba8d711-7863-4eee-a102-90bc23b3e4d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039217 Jan 05 15:15:40.606220 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 605/1209] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:15:40.607419 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Going to try to terminate instance {{(pid=128789) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:15:40.899451 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 204 len: 0 microversion: 2.1 time: 0.336690 Jan 05 15:15:40.903369 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 605/1210] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:15:40 2022] DELETE /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:15:40.909607 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-793773d3-cafd-4fe6-beb9-4388fa6363a9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:15:40.910317 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-793773d3-cafd-4fe6-beb9-4388fa6363a9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:15:40.918042 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-793773d3-cafd-4fe6-beb9-4388fa6363a9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:40.918416 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-793773d3-cafd-4fe6-beb9-4388fa6363a9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:40.919225 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-793773d3-cafd-4fe6-beb9-4388fa6363a9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:40.919660 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-793773d3-cafd-4fe6-beb9-4388fa6363a9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:41.193103 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-793773d3-cafd-4fe6-beb9-4388fa6363a9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:15:41.200768 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-793773d3-cafd-4fe6-beb9-4388fa6363a9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1576 microversion: 2.1 time: 0.296116 Jan 05 15:15:41.201464 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 606/1211] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:15:40 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1576 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:15:42.220396 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-34b4d15b-d3dc-4f54-b063-e7d24988efe5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:15:42.221114 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-34b4d15b-d3dc-4f54-b063-e7d24988efe5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:15:42.227375 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-34b4d15b-d3dc-4f54-b063-e7d24988efe5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:42.227816 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-34b4d15b-d3dc-4f54-b063-e7d24988efe5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:42.228587 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-34b4d15b-d3dc-4f54-b063-e7d24988efe5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:42.229014 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-34b4d15b-d3dc-4f54-b063-e7d24988efe5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:42.408682 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-34b4d15b-d3dc-4f54-b063-e7d24988efe5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:15:42.416085 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-34b4d15b-d3dc-4f54-b063-e7d24988efe5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1457 microversion: 2.1 time: 0.200593 Jan 05 15:15:42.416651 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 606/1212] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:15:42 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1457 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:15:43.194088 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a2ccf36c-c4f3-4737-a694-0a8449247998 req-50911d98-77be-46ed-8584-14cb27c503fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c", "name": "network-vif-deleted", "tag": "113c50f8-3fe6-4232-9abc-c3a1f377fc13"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:15:43.195906 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:15:43.195906 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: warnings.warn(msg) Jan 05 15:15:43.203441 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a2ccf36c-c4f3-4737-a694-0a8449247998 req-50911d98-77be-46ed-8584-14cb27c503fd service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:43.207591 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a2ccf36c-c4f3-4737-a694-0a8449247998 req-50911d98-77be-46ed-8584-14cb27c503fd service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:43.214565 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a2ccf36c-c4f3-4737-a694-0a8449247998 req-50911d98-77be-46ed-8584-14cb27c503fd service nova] Creating event network-vif-deleted:113c50f8-3fe6-4232-9abc-c3a1f377fc13 for instance a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c on hv-cinder-maste Jan 05 15:15:43.220166 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a2ccf36c-c4f3-4737-a694-0a8449247998 req-50911d98-77be-46ed-8584-14cb27c503fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029713 Jan 05 15:15:43.232068 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 607/1213] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 15:15:43.433649 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2e098ce3-0d1a-4ede-a7f0-8714ad027591 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:15:43.434184 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2e098ce3-0d1a-4ede-a7f0-8714ad027591 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:15:43.440045 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2e098ce3-0d1a-4ede-a7f0-8714ad027591 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:43.440495 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2e098ce3-0d1a-4ede-a7f0-8714ad027591 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:43.441299 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2e098ce3-0d1a-4ede-a7f0-8714ad027591 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:43.441740 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2e098ce3-0d1a-4ede-a7f0-8714ad027591 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:43.501935 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-2e098ce3-0d1a-4ede-a7f0-8714ad027591 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:15:43.512368 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2e098ce3-0d1a-4ede-a7f0-8714ad027591 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1226 microversion: 2.1 time: 0.082582 Jan 05 15:15:43.512963 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 607/1214] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:15:43 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:15:44.529798 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-11a63506-d56e-4e5b-b992-b16571fdaa60 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:15:44.530488 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-11a63506-d56e-4e5b-b992-b16571fdaa60 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:15:44.536671 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11a63506-d56e-4e5b-b992-b16571fdaa60 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:44.537149 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11a63506-d56e-4e5b-b992-b16571fdaa60 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:44.537931 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11a63506-d56e-4e5b-b992-b16571fdaa60 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:44.538517 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11a63506-d56e-4e5b-b992-b16571fdaa60 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:44.570035 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11a63506-d56e-4e5b-b992-b16571fdaa60 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:44.570475 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11a63506-d56e-4e5b-b992-b16571fdaa60 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:44.571058 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-11a63506-d56e-4e5b-b992-b16571fdaa60 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lazy-loading 'fault' on Instance uuid a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:15:44.614269 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-11a63506-d56e-4e5b-b992-b16571fdaa60 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:15:44.620883 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-11a63506-d56e-4e5b-b992-b16571fdaa60 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 200 len: 1185 microversion: 2.1 time: 0.095526 Jan 05 15:15:44.621472 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 608/1215] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:15:44 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 1185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:15:45.638422 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7ab5320d-4de9-4786-b37c-d30539ecf415 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:15:45.639031 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-7ab5320d-4de9-4786-b37c-d30539ecf415 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:15:45.645790 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7ab5320d-4de9-4786-b37c-d30539ecf415 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:45.646237 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7ab5320d-4de9-4786-b37c-d30539ecf415 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:45.647014 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7ab5320d-4de9-4786-b37c-d30539ecf415 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:45.647451 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-7ab5320d-4de9-4786-b37c-d30539ecf415 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:45.662916 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-7ab5320d-4de9-4786-b37c-d30539ecf415 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] HTTP exception thrown: Instance a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c could not be found. Jan 05 15:15:45.663482 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-7ab5320d-4de9-4786-b37c-d30539ecf415 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Returning 404 to user: Instance a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:15:45.664285 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-7ab5320d-4de9-4786-b37c-d30539ecf415 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c" status: 404 len: 111 microversion: 2.1 time: 0.029643 Jan 05 15:15:45.664837 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 608/1216] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:15:45 2022] GET /compute/v2.1/servers/a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:15:49.040962 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:15:49.041587 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:15:49.044255 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-93c213c5-3231-4123-aa21-fbe050f1d68c req-19835338-90c2-4605-9d27-3b552da6d567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7fa3a7a-27e0-4b5d-a172-1af7d87cde71", "tag": "5fd3adff-46db-4f6c-976b-1c61edeb54cb"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:15:49.047196 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:15:49.047196 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:15:49.048814 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:49.049363 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:49.050219 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:49.050869 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:49.054380 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-93c213c5-3231-4123-aa21-fbe050f1d68c req-19835338-90c2-4605-9d27-3b552da6d567 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:49.054824 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-93c213c5-3231-4123-aa21-fbe050f1d68c req-19835338-90c2-4605-9d27-3b552da6d567 service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:49.066038 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-93c213c5-3231-4123-aa21-fbe050f1d68c req-19835338-90c2-4605-9d27-3b552da6d567 service nova] Creating event network-changed:5fd3adff-46db-4f6c-976b-1c61edeb54cb for instance f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 on hv-cinder-maste Jan 05 15:15:49.071211 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-93c213c5-3231-4123-aa21-fbe050f1d68c req-19835338-90c2-4605-9d27-3b552da6d567 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030614 Jan 05 15:15:49.072109 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 609/1217] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:15:49.078178 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 05 15:15:49.345876 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 204 len: 0 microversion: 2.1 time: 0.308805 Jan 05 15:15:49.346489 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 609/1218] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:15:49 2022] DELETE /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 15:15:49.354868 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-40d10d1a-6e5c-422d-b203-0fa478e9d339 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:15:49.355809 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-40d10d1a-6e5c-422d-b203-0fa478e9d339 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:15:49.367282 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-40d10d1a-6e5c-422d-b203-0fa478e9d339 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:49.368040 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-40d10d1a-6e5c-422d-b203-0fa478e9d339 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:49.368843 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-40d10d1a-6e5c-422d-b203-0fa478e9d339 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:49.369313 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-40d10d1a-6e5c-422d-b203-0fa478e9d339 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:49.513267 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-40d10d1a-6e5c-422d-b203-0fa478e9d339 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:15:49.521444 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-40d10d1a-6e5c-422d-b203-0fa478e9d339 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1574 microversion: 2.1 time: 0.170512 Jan 05 15:15:49.522099 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 610/1219] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:15:49 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:15:50.539483 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cd0eb783-11aa-448f-b49d-007ce0b8df41 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:15:50.540210 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cd0eb783-11aa-448f-b49d-007ce0b8df41 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:15:50.546640 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd0eb783-11aa-448f-b49d-007ce0b8df41 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:50.547090 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd0eb783-11aa-448f-b49d-007ce0b8df41 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:50.547867 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd0eb783-11aa-448f-b49d-007ce0b8df41 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:50.548300 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd0eb783-11aa-448f-b49d-007ce0b8df41 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:50.683522 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-cd0eb783-11aa-448f-b49d-007ce0b8df41 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:15:50.691532 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cd0eb783-11aa-448f-b49d-007ce0b8df41 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1456 microversion: 2.1 time: 0.156130 Jan 05 15:15:50.692108 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 610/1220] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:15:50 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1456 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:15:51.616976 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [req-7b8a27df-44d5-41ef-bc7d-6cafc3770e37 req-1fcf63b4-abe3-4a01-8429-305eff62ba0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7fa3a7a-27e0-4b5d-a172-1af7d87cde71", "name": "network-vif-deleted", "tag": "5fd3adff-46db-4f6c-976b-1c61edeb54cb"}]} {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 15:15:51.618506 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:15:51.618506 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: warnings.warn(msg) Jan 05 15:15:51.625627 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-7b8a27df-44d5-41ef-bc7d-6cafc3770e37 req-1fcf63b4-abe3-4a01-8429-305eff62ba0b service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:51.626067 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [req-7b8a27df-44d5-41ef-bc7d-6cafc3770e37 req-1fcf63b4-abe3-4a01-8429-305eff62ba0b service nova] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:51.636693 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.compute.server_external_events [req-7b8a27df-44d5-41ef-bc7d-6cafc3770e37 req-1fcf63b4-abe3-4a01-8429-305eff62ba0b service nova] Creating event network-vif-deleted:5fd3adff-46db-4f6c-976b-1c61edeb54cb for instance f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 on hv-cinder-maste Jan 05 15:15:51.641930 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [req-7b8a27df-44d5-41ef-bc7d-6cafc3770e37 req-1fcf63b4-abe3-4a01-8429-305eff62ba0b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028562 Jan 05 15:15:51.642504 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 611/1221] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Jan 5 15:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 15:15:51.708705 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-30bff43c-d90d-48e7-8af4-05e635480ea3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:15:51.709566 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-30bff43c-d90d-48e7-8af4-05e635480ea3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:15:51.717486 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30bff43c-d90d-48e7-8af4-05e635480ea3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:51.718806 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30bff43c-d90d-48e7-8af4-05e635480ea3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:51.719576 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30bff43c-d90d-48e7-8af4-05e635480ea3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:51.720006 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30bff43c-d90d-48e7-8af4-05e635480ea3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:51.778711 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.policy [None req-30bff43c-d90d-48e7-8af4-05e635480ea3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:15:51.786578 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-30bff43c-d90d-48e7-8af4-05e635480ea3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1389 microversion: 2.1 time: 0.082249 Jan 05 15:15:51.787142 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 611/1222] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:15:51 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:15:52.803948 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-b22ca1ca-5a29-4746-9364-6dc2866bbe2a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:15:52.804653 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-b22ca1ca-5a29-4746-9364-6dc2866bbe2a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:15:52.810555 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b22ca1ca-5a29-4746-9364-6dc2866bbe2a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:52.811010 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b22ca1ca-5a29-4746-9364-6dc2866bbe2a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:52.812264 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b22ca1ca-5a29-4746-9364-6dc2866bbe2a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:52.812711 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b22ca1ca-5a29-4746-9364-6dc2866bbe2a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:52.843336 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b22ca1ca-5a29-4746-9364-6dc2866bbe2a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:52.843777 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-b22ca1ca-5a29-4746-9364-6dc2866bbe2a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:52.844221 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.objects.instance [None req-b22ca1ca-5a29-4746-9364-6dc2866bbe2a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lazy-loading 'fault' on Instance uuid f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 {{(pid=128789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 05 15:15:52.882206 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.policy [None req-b22ca1ca-5a29-4746-9364-6dc2866bbe2a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bfbcae996a457ebe52d8c2fb7bafe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128789) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 15:15:52.889323 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-b22ca1ca-5a29-4746-9364-6dc2866bbe2a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 200 len: 1230 microversion: 2.1 time: 0.089969 Jan 05 15:15:52.889890 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 612/1223] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:15:52 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 1230 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 15:15:53.906970 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8a234dd7-ded8-45c4-9784-bc66426ca15d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:15:53.907600 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8a234dd7-ded8-45c4-9784-bc66426ca15d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: f7fa3a7a-27e0-4b5d-a172-1af7d87cde71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:15:53.913886 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a234dd7-ded8-45c4-9784-bc66426ca15d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:53.914327 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a234dd7-ded8-45c4-9784-bc66426ca15d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:53.915091 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a234dd7-ded8-45c4-9784-bc66426ca15d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:53.915516 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a234dd7-ded8-45c4-9784-bc66426ca15d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:53.928191 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-8a234dd7-ded8-45c4-9784-bc66426ca15d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] HTTP exception thrown: Instance f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 could not be found. Jan 05 15:15:53.928758 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8a234dd7-ded8-45c4-9784-bc66426ca15d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Returning 404 to user: Instance f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:15:53.929572 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8a234dd7-ded8-45c4-9784-bc66426ca15d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71" status: 404 len: 111 microversion: 2.1 time: 0.026936 Jan 05 15:15:53.930082 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 612/1224] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:15:53 2022] GET /compute/v2.1/servers/f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:15:54.455667 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2ece3c5e-7c43-493a-9784-5d61406a1655 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:15:54.456160 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.compute.api [None req-2ece3c5e-7c43-493a-9784-5d61406a1655 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128789) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:15:54.462353 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2ece3c5e-7c43-493a-9784-5d61406a1655 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:54.462799 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2ece3c5e-7c43-493a-9784-5d61406a1655 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:54.463571 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2ece3c5e-7c43-493a-9784-5d61406a1655 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:54.464004 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG oslo_concurrency.lockutils [None req-2ece3c5e-7c43-493a-9784-5d61406a1655 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:54.477687 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.wsgi [None req-2ece3c5e-7c43-493a-9784-5d61406a1655 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] HTTP exception thrown: Instance 7f6d3cac-1745-4d46-ba6c-7342079f99b8 could not be found. Jan 05 15:15:54.478261 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-2ece3c5e-7c43-493a-9784-5d61406a1655 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Returning 404 to user: Instance 7f6d3cac-1745-4d46-ba6c-7342079f99b8 could not be found. {{(pid=128789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:15:54.479107 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-2ece3c5e-7c43-493a-9784-5d61406a1655 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 404 len: 111 microversion: 2.1 time: 0.027750 Jan 05 15:15:54.479585 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 613/1225] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Jan 5 15:15:54 2022] DELETE /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:15:54.488192 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a28d519d-04fc-486a-a603-84a5aa158e8c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:15:54.488834 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a28d519d-04fc-486a-a603-84a5aa158e8c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] [instance: 7f6d3cac-1745-4d46-ba6c-7342079f99b8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 05 15:15:54.494902 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a28d519d-04fc-486a-a603-84a5aa158e8c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:54.495345 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a28d519d-04fc-486a-a603-84a5aa158e8c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:54.496119 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a28d519d-04fc-486a-a603-84a5aa158e8c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 15:15:54.496544 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a28d519d-04fc-486a-a603-84a5aa158e8c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Lock "9ee8715e-15f7-4a00-a6ea-b782f272eaf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 15:15:54.511462 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-a28d519d-04fc-486a-a603-84a5aa158e8c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] HTTP exception thrown: Instance 7f6d3cac-1745-4d46-ba6c-7342079f99b8 could not be found. Jan 05 15:15:54.511989 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a28d519d-04fc-486a-a603-84a5aa158e8c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Returning 404 to user: Instance 7f6d3cac-1745-4d46-ba6c-7342079f99b8 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 15:15:54.512806 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a28d519d-04fc-486a-a603-84a5aa158e8c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8" status: 404 len: 111 microversion: 2.1 time: 0.028926 Jan 05 15:15:54.513367 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 613/1226] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Jan 5 15:15:54 2022] GET /compute/v2.1/servers/7f6d3cac-1745-4d46-ba6c-7342079f99b8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 15:15:55.954842 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: DEBUG nova.api.openstack.wsgi [None req-a2851d51-be1d-43b5-be29-337f6de92274 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling method '.version_select at 0x7f21726158b0>' {{(pid=128789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 15:15:56.026219 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO nova.api.openstack.requestlog [None req-a2851d51-be1d-43b5-be29-337f6de92274 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2013176654" status: 202 len: 0 microversion: 2.1 time: 0.075401 Jan 05 15:15:56.026806 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: [pid: 128789|app: 0|req: 614/1227] 10.222.0.30 () {58 vars in 1262 bytes} [Wed Jan 5 15:15:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2013176654 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 05 15:17:47.686927 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 15:17:47.687430 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: Wed Jan 5 15:17:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 15:18:12.900737 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 15:18:12.901355 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: Wed Jan 5 15:18:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 15:18:55.586752 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 15:18:55.587354 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: Wed Jan 5 15:18:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 15:19:38.822122 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 15:19:38.822832 dv-cinder-master-3-iscsi devstack@n-api.service[128788]: Wed Jan 5 15:19:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 15:21:07.697595 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 15:21:07.699497 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: Wed Jan 5 15:21:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 15:21:16.636280 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 15:21:16.636891 dv-cinder-master-3-iscsi devstack@n-api.service[128789]: Wed Jan 5 15:21:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!